00000001:02000400:2.0F:1787764750.717935:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing set_hostid 00000001:02000400:2.0:1787764759.145114:0:3163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787764759.940228:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1675 MB/s 00000001:01000000:0.0:1787764760.190096:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1571 MB/s 00000001:01000000:0.0:1787764760.439775:0:3226:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8839 MB/s 00000020:02000000:2.0:1787764760.902488:0:3255:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_118_g5fc7b69 00000400:02000000:3.0F:1787764761.309125:0:3270:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.145@tcp [8/256/0/180] 00008000:02000000:3.0:1787764764.072015:0:3419:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787764789.109745:0:5219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787764794.611418:0:5784:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787764794.611425:0:5784:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787764794.611701:0:5784:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a5ed8383 00000080:02000400:0.0:1787764794.611711:0:5784:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787764794.613836:0:5784:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787764794.613923:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787764794.613964:0:5784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000061f5a270) 00000020:00000080:0.0:1787764794.613982:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1787764794.626296:0:5784:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787764794.626638:0:5784:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787764794.638563:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787764794.638636:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787764794.638656:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787764794.638707:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787764794.638733:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787764794.638988:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787764794.638994:0:5784:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787764794.639000:0:5784:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ec49d1dfa4e2073 00000020:01000004:0.0:1787764794.639006:0:5784:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787764794.639010:0:5784:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787764794.639012:0:5784:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a5ed8383 from MGS 00000020:01000004:0.0:1787764794.639016:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787764794.639022:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b80abc0e) 00000020:00000080:0.0:1787764794.639029:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787764794.639064:0:5784:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a5ed8383 from MGS, refs=2 00080000:01000000:0.0:1787764794.639067:0:5784:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787764794.639070:0:5784:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ec49d1dfa4e2081 00000100:00100000:0.0:1787764794.639140:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787764794.639235:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787764794.639246:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787764794.639690:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787764794.639698:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787764794.640185:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764794.640321:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787764794.640326:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787764794.640917:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787764794.640922:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787764794.641185:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787764794.641189:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787764794.641678:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764794.641682:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764794.641683:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764794.641903:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764794.641906:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764794.641907:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764794.642291:0:5784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787764794.646641:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787764794.891750:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5935 MB/s 00000001:01000000:1.0:1787764795.142663:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5175 MB/s 00000001:01000000:3.0:1787764795.393886:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 840 MB/s 00000001:01000000:2.0:1787764795.644842:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 729 MB/s 00080000:10000000:3.0:1787764795.650531:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787764795.661710:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787764795.661749:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787764795.661764:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787764795.661767:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787764795.662398:0:5794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787764795.662556:0:5784:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787764795.662713:0:5784:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787764795.662879:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787764795.662978:0:5784:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787764795.663370:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764795.663715:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787764795.663721:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787764795.666275:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787764795.666287:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787764795.666767:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787764795.666774:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787764795.669992:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787764795.670015:0:5784:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.145@tcp' 00000020:01000004:0.0:1787764795.670017:0:5784:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787764795.670070:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.145@tcp (typ=mgc) 00000020:00000080:0.0:1787764795.670081:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.145@tcp (000000000dd34189) 00000020:00000080:0.0:1787764795.670098:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787764795.670189:0:5784:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000505032c0@MGC192.168.202.145@tcp: add connection 192.168.202.145@tcp at head 00010000:00010000:0.0:1787764795.670724:0:5784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.145@tcp-0 is initialized 00000040:01000000:0.0:1787764795.670730:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.145@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787764795.671617:0:5799:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787764795.672182:0:5800:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787764795.672218:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.145@tcp (uuid 3db9464f-230d-4339-9306-352e25163ce7) 00000020:00000080:2.0:1787764795.672235:0:5784:0:(genops.c:1385:class_connect()) connect: client 3db9464f-230d-4339-9306-352e25163ce7, cookie 0x3ec49d1dfa4e208f 00000100:00080000:2.0:1787764795.672245:0:5784:0:(import.c:510:import_select_connection()) MGC192.168.202.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787764795.672250:0:5784:0:(import.c:624:import_select_connection()) MGC192.168.202.145@tcp: import 00000000505032c0 using connection 192.168.202.145@tcp/0@lo 00000100:00100000:2.0:1787764795.672281:0:5784:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000096d3842b x1874607222030464/t0(0) o250->MGC192.168.202.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787764795.672301:0:5784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3db9464f-230d-4339-9306-352e25163ce7->MGS 00000020:01000004:2.0:1787764795.672316:0:5784:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787764795.672338:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787764795.672357:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000ddbb516) 00000020:00000080:2.0:1787764795.672370:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787764795.672690:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096d3842b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3db9464f-230d-4339-9306-352e25163ce7:3285:1874607222030464:0@lo:250: 00000100:00100000:3.0:1787764795.672761:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764795.672831:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222030464 00000100:00100000:0.0:1787764795.672837:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222030464 00000100:00100000:0.0:1787764795.672863:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787764795.672869:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099f9d602 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1874607222030464:12345-0@lo:250: 00010000:00080000:0.0:1787764795.672914:0:5796:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 3db9464f-230d-4339-9306-352e25163ce7@0@lo t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:0.0:1787764795.672932:0:5796:0:(genops.c:1385:class_connect()) connect: client 3db9464f-230d-4339-9306-352e25163ce7, cookie 0x3ec49d1dfa4e209d 00000100:00080000:0.0:1787764795.673042:0:5796:0:(import.c:65:import_set_state_nolock()) 0000000040a7ca73 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787764795.673117:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099f9d602 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+5:3285:x1874607222030464:12345-0@lo:250: Request processed in 247us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764795.673125:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787764795.673626:0:3285:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787764795.673635:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.145@tcp: connect to target with instance 0 00000100:00080000:3.0:1787764795.673643:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787764795.673646:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787764795.673649:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000505032c0 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787764795.673651:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787764795.673662:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787764795.673666:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096d3842b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3db9464f-230d-4339-9306-352e25163ce7:3285:1874607222030464:0@lo:250: 00000100:00100000:2.0:1787764795.693140:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764795.693313:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787764795.693318:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787764795.694523:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787764795.694536:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787764795.695397:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787764795.695406:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787764795.696117:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764795.696348:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787764795.696354:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787764795.696843:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787764795.696850:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787764795.725557:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764795.725789:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787764795.725795:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787764795.726377:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787764795.726384:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787764795.726892:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764795.726993:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787764795.726996:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787764795.727275:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787764795.727280:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787764795.727697:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764795.727843:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787764795.727852:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787764795.728291:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787764795.728297:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787764795.728775:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764795.728852:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787764795.728855:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787764795.729139:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787764795.729144:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787764795.743336:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764795.743532:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787764795.743539:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787764795.745917:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787764795.745936:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787764795.748062:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787764795.748075:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787764795.749549:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787764795.749602:0:5784:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787764795.749609:0:5784:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787764795.749723:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787764795.749756:0:5784:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.145@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787764795.749760:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787764795.749762:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787764795.749763:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764795.749765:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764795.749766:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764795.749767:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764795.749768:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787764795.749770:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787764795.749771:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764795.749773:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764795.749774:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764795.749775:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787764795.749777:0:5784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787764795.749779:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787764795.749780:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787764795.749781:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764795.749782:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764795.749783:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764795.749784:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764795.749785:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787764795.749786:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787764795.749792:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764795.749792:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764795.749793:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764795.749794:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787764795.749826:0:5784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787764795.749842:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5940299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222030592:0@lo:253: 00000100:00100000:2.0:1787764795.749907:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764795.750012:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 0000000083822e01 going to sleep for 11 seconds 00000100:00100000:3.0:1787764795.750687:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222030592 00000100:00100000:3.0:1787764795.750694:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222030592 00000100:00100000:3.0:1787764795.750742:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787764795.750751:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000409fb0cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+5:5784:x1874607222030592:12345-0@lo:253: 20000000:01000000:3.0:1787764795.750794:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787764795.750797:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787764795.751194:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787764795.751252:0:5798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787764795.751474:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787764795.756855:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787764795.757343:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787764795.757347:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787764795.757352:0:5798:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787764795.757356:0:5798:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787764795.757371:0:5798:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787764795.757645:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764795.757874:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787764795.757887:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787764795.757939:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787764795.757986:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787764795.758026:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787764795.758111:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787764795.758120:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787764795.758163:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787764795.758171:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787764795.758216:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787764795.758224:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787764795.758254:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787764795.758303:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787764795.758333:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787764795.758337:0:5798:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787764795.758351:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764795.758536:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787764795.758546:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787764795.758624:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787764795.758672:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787764795.758727:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787764795.758738:0:5798:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787764795.758811:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787764795.758821:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787764795.758877:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787764795.758918:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787764795.758954:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787764795.758965:0:5798:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787764795.759045:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787764795.759054:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787764795.759086:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787764795.759124:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787764795.759296:0:5798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787764795.759343:0:5798:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787764795.759355:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787764795.760098:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787764795.760452:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787764795.760472:0:5798:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.145@tcp for mdt 20000000:01000000:3.0:1787764795.760474:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.145@tcp (null) (null) (null) 00000040:00080000:3.0:1787764795.760508:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787764795.760516:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787764795.760573:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787764795.760690:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.145@tcp (null) (null) 00000040:00080000:3.0:1787764795.760746:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787764795.760756:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787764795.760789:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787764795.760824:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787764795.760883:0:5798:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787764795.760887:0:5798:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787764795.760892:0:5798:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787764795.760898:0:5798:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787764795.761261:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787764795.761433:0:5798:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787764795.765910:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787764795.765963:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1787764795.766060:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1787764795.766080:0:5798:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787764795.766083:0:5798:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787764795.766087:0:5798:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787764795.766099:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787764795.766101:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787764795.766131:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787764795.766133:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787764795.770777:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1787764795.771112:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1787764795.771158:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1787764795.771246:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1787764795.771259:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787764795.771261:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787764795.771732:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787764795.771934:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787764795.771974:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787764795.772008:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787764795.772021:0:5798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787764795.772023:0:5798:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1787764795.772029:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787764795.772046:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772061:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772070:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772076:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772081:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772087:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772092:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000048a8913c already unused, calling callback (000000004b21288f) 00010000:00010000:3.0:1787764795.772095:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772102:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772123:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772130:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.772135:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000048a8913c/0x3ec49d1dfa4e20a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787764795.772150:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787764795.920460:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000409fb0cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+5:5784:x1874607222030592:12345-0@lo:253: Request processed in 169704us (170547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764795.920476:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787764795.920575:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5940299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222030592:0@lo:253: 10000000:01000000:3.0:1787764795.921631:0:5784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787764795.921637:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787764795.921639:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787764795.921641:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764795.921642:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787764795.921643:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764795.921644:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764795.921645:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787764795.921647:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787764795.921648:0:5784:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787764795.921649:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764795.921651:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787764795.921671:0:5784:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a5ed8383 from lustre-MDT0000 10000000:01000000:3.0:1787764795.921696:0:5784:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787764795.921698:0:5784:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787764795.921702:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90dc97e31a48 10000000:01000000:3.0:1787764795.921706:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787764795.921713:0:5784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90dc97e31a48 from 1 10000000:01000000:3.0:1787764795.921715:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787764795.921749:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.921775:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.921784:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764795.921803:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222030720:0@lo:101: 00000100:00100000:3.0:1787764795.921842:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764795.921903:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c538c191 going to sleep for 11 seconds 00000100:00100000:0.0:1787764795.921926:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222030720 00000100:00100000:0.0:1787764795.921932:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222030720 00000100:00100000:0.0:1787764795.921974:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787764795.921983:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7bd12a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+5:5784:x1874607222030720:12345-0@lo:101: 00010000:00010000:0.0:1787764795.921994:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764795.922006:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e20ab expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.922027:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.922036:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.922045:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d08b794, rc 0) 00000100:00100000:0.0:1787764795.922079:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7bd12a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+6:5784:x1874607222030720:12345-0@lo:101: Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764795.922086:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787764795.922105:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222030720:0@lo:101: 00010000:00010000:3.0:1787764795.922116:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.922124:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764795.922170:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222030848:0@lo:501: 00000100:00100000:3.0:1787764795.922208:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764795.922228:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c538c191 going to sleep for 11 seconds 00000100:00100000:0.0:1787764795.922265:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222030848 00000100:00100000:0.0:1787764795.922269:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222030848 00000100:00100000:0.0:1787764795.922295:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787764795.922301:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8941629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+6:5784:x1874607222030848:12345-0@lo:501: 00000100:00100000:0.0:1787764795.922482:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8941629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+6:5784:x1874607222030848:12345-0@lo:501: Request processed in 181us (273us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764795.922489:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787764795.922509:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222030848:0@lo:501: 10000000:01000000:3.0:1787764795.922531:0:5784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787764795.922548:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.922554:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764795.922581:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90dc85d67000 10000000:01000000:3.0:1787764795.922612:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787764795.922616:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90dc85d67000 10000000:01000000:3.0:1787764795.922619:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787764795.922622:0:5784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90dc85d67000 from 1 10000000:01000000:3.0:1787764795.922624:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787764795.922636:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 00000000939b0748/0x3ec49d1dfa4e20b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.922643:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 00000000939b0748/0x3ec49d1dfa4e20b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.922650:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 00000000939b0748/0x3ec49d1dfa4e20b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764795.922661:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222030976:0@lo:101: 00000100:00100000:3.0:1787764795.922684:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764795.922708:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c538c191 going to sleep for 11 seconds 00000100:00100000:0.0:1787764795.922782:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222030976 00000100:00100000:0.0:1787764795.922790:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222030976 00000100:00100000:0.0:1787764795.922811:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787764795.922816:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000841bd908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+6:5784:x1874607222030976:12345-0@lo:101: 00010000:00010000:0.0:1787764795.922823:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764795.922831:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000cdbd410/0x3ec49d1dfa4e20c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e20b9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.922844:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000cdbd410/0x3ec49d1dfa4e20c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e20b9 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.922852:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000cdbd410/0x3ec49d1dfa4e20c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e20b9 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.922858:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000cdbd410, rc 0) 00000100:00100000:0.0:1787764795.922896:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000841bd908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+7:5784:x1874607222030976:12345-0@lo:101: Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764795.922901:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764795.922901:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222030976:0@lo:101: 00010000:00010000:3.0:1787764795.922909:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 00000000939b0748/0x3ec49d1dfa4e20b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20c0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.922916:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 00000000939b0748/0x3ec49d1dfa4e20b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e20c0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764795.922936:0:5784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787764795.922949:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 00000000939b0748/0x3ec49d1dfa4e20b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20c0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.922968:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 00000000939b0748/0x3ec49d1dfa4e20b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20c0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764795.922974:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787764795.922977:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787764795.922981:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90dc85d67000 10000000:01000000:3.0:1787764795.922983:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787764795.922985:0:5784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787764795.922987:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787764795.922999:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.923005:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764795.923011:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764795.923022:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031104:0@lo:101: 00000100:00100000:3.0:1787764795.923045:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764795.923065:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c538c191 going to sleep for 11 seconds 00000100:00100000:0.0:1787764795.923182:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222031104 00000100:00100000:0.0:1787764795.923186:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222031104 00000100:00100000:0.0:1787764795.923213:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787764795.923219:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b233f11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+7:5784:x1874607222031104:12345-0@lo:101: 00010000:00010000:0.0:1787764795.923226:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764795.923236:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e20c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.923249:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.923255:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764795.923270:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000212d89d7, rc 0) 00000100:00100000:0.0:1787764795.923307:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b233f11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+8:5784:x1874607222031104:12345-0@lo:101: Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764795.923314:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787764795.923374:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031104:0@lo:101: 00010000:00010000:2.0:1787764795.923385:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764795.923404:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764795.923445:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031232:0@lo:501: 00000100:00100000:2.0:1787764795.923473:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764795.923547:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e58b13c going to sleep for 11 seconds 00000100:00100000:0.0:1787764795.923669:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222031232 00000100:00100000:0.0:1787764795.923673:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222031232 00000100:00100000:0.0:1787764795.923699:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787764795.923704:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092dd1829 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+8:5784:x1874607222031232:12345-0@lo:501: 00000100:00100000:0.0:1787764795.923924:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092dd1829 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+9:5784:x1874607222031232:12345-0@lo:501: Request processed in 219us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764795.923932:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787764795.925655:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031232:0@lo:501: 00000100:00100000:2.0:1787764795.925715:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031360:0@lo:503: 00000100:00100000:2.0:1787764795.925778:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764795.925863:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e58b13c going to sleep for 11 seconds 00000100:00100000:0.0:1787764795.925910:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222031360 00000100:00100000:0.0:1787764795.925916:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222031360 00000100:00100000:0.0:1787764795.925962:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787764795.925970:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a4a55c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+9:5784:x1874607222031360:12345-0@lo:503: 00000100:00100000:0.0:1787764795.926474:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a4a55c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+9:5784:x1874607222031360:12345-0@lo:503: Request processed in 505us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764795.926482:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787764795.926548:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031360:0@lo:503: 00000100:00100000:1.0:1787764795.930334:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094a034ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:5827:1874607222031488:0@lo:502: 00000100:00100000:1.0:1787764795.930477:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764795.930578:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092d0fd59 going to sleep for 11 seconds 00000100:00100000:0.0:1787764795.931724:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222031488 00000100:00100000:0.0:1787764795.931733:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222031488 00000100:00100000:0.0:1787764795.931780:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787764795.931789:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d95587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+9:5827:x1874607222031488:12345-0@lo:502: 00000100:00100000:0.0:1787764795.932131:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d95587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+9:5827:x1874607222031488:12345-0@lo:502: Request processed in 343us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764795.932140:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787764795.932274:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094a034ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:5827:1874607222031488:0@lo:502: 00000020:01000000:1.0:1787764795.932306:0:5827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764795.932316:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764795.932318:0:5827:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787764795.932323:0:5827:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787764795.932325:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787764795.932347:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000aeaf5432) 00000020:00000080:1.0:1787764795.932362:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787764795.932368:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787764795.932637:0:5827:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787764795.932644:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ec49d1dfa4e20dc 00000020:00000080:1.0:1787764795.932827:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787764795.932831:0:5827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764795.932834:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764795.932836:0:5827:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787764795.932838:0:5827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764795.932841:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764795.932842:0:5827:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787764795.932845:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787764795.932850:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005e7010f1) 00000020:00000080:1.0:1787764795.932858:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787764795.932865:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787764795.932867:0:5827:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787764795.932870:0:5827:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787764795.932875:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787764795.933135:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a5ed8383 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787764795.933146:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007b25d2ae) 00000020:00000080:1.0:1787764795.933206:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787764795.933262:0:5827:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787764795.933267:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ec49d1dfa4e20f1 00000020:00000080:1.0:1787764795.933354:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787764795.933358:0:5827:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787764795.933362:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3ec49d1dfa4e20f8 00080000:01000000:1.0:1787764795.933365:0:5827:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787764795.933368:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ec49d1dfa4e20ff 00080000:10000000:1.0:1787764795.934126:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787764795.934315:0:5827:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787764795.936851:0:5827:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787764796.035163:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787764796.035510:0:5827:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787764796.038836:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787764796.039321:0:5827:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787764796.109708:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000cc8f55b0) 00000020:00000080:0.0:1787764796.109734:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787764796.109795:0:5827:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787764796.109810:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ec49d1dfa4e210d 00000020:00000080:1.0:1787764796.110868:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787764796.117819:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787764796.169876:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.225196:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.266997:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.311015:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.341899:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787764796.365863:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3ec49d1dfa4e2114 00000020:00000080:0.0:1787764796.366123:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787764796.366135:0:5827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764796.366141:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764796.366143:0:5827:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787764796.366146:0:5827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764796.366152:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764796.366153:0:5827:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787764796.366157:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787764796.366189:0:5827:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787764796.366202:0:5827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764796.366204:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764796.366206:0:5827:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787764796.366208:0:5827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764796.366210:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764796.366212:0:5827:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787764796.366214:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787764796.366215:0:5827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787764796.366258:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000530d2f31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:5827:1874607222031616:0@lo:502: 00000100:00100000:0.0:1787764796.366340:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764796.366474:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000477568bb going to sleep for 11 seconds 00000100:00100000:2.0:1787764796.366545:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222031616 00000100:00100000:2.0:1787764796.366550:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222031616 00000100:00100000:3.0:1787764796.366809:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764796.366817:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a6e2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+9:5827:x1874607222031616:12345-0@lo:502: 00000100:00100000:3.0:1787764796.367038:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a6e2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+9:5827:x1874607222031616:12345-0@lo:502: Request processed in 222us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764796.367046:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787764796.367073:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000530d2f31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:5827:1874607222031616:0@lo:502: 00000020:01000000:0.0:1787764796.367098:0:5827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764796.367102:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764796.367104:0:5827:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787764796.367106:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787764796.367234:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787764796.367255:0:5784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787764796.367273:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.367283:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764796.367290:0:5784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90dc85d67000 from 1 10000000:01000000:2.0:1787764796.367292:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787764796.367315:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.367323:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.367332:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764796.367344:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031744:0@lo:101: 00000100:00100000:2.0:1787764796.367372:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764796.367500:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ce09dae going to sleep for 11 seconds 00000100:00100000:1.0:1787764796.367577:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222031744 00000100:00100000:1.0:1787764796.367669:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222031744 00000100:00100000:1.0:1787764796.367705:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787764796.367711:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068b1bacf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+9:5784:x1874607222031744:12345-0@lo:101: 00010000:00010000:1.0:1787764796.367720:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764796.367732:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e211b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764796.367752:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764796.367761:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764796.367782:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fb581fa, rc 0) 00000100:00100000:1.0:1787764796.367856:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068b1bacf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+10:5784:x1874607222031744:12345-0@lo:101: Request processed in 145us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764796.367863:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787764796.367909:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031744:0@lo:101: 00010000:00010000:2.0:1787764796.367925:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.367933:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764796.368550:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031872:0@lo:256: 00000100:00100000:3.0:1787764796.369483:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764796.369526:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ce09dae going to sleep for 11 seconds 00000100:00100000:0.0:1787764796.369531:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222031872 00000100:00100000:0.0:1787764796.369543:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222031872 00000100:00100000:0.0:1787764796.369683:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787764796.369693:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068585803 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+10:5784:x1874607222031872:12345-0@lo:256: 20000000:01000000:0.0:1787764796.369715:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787764796.369724:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787764796.369802:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068585803 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+10:5784:x1874607222031872:12345-0@lo:256: Request processed in 112us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764796.369810:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787764796.369961:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222031872:0@lo:256: 10000000:01000000:2.0:1787764796.370577:0:5784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787764796.370618:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.370628:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764796.370636:0:5784:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dc85d67000 from 1 10000000:01000000:2.0:1787764796.370639:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787764796.370668:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.370675:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.370683:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764796.370698:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032000:0@lo:101: 00000100:00100000:2.0:1787764796.370732:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764796.371024:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ce09dae going to sleep for 11 seconds 00000100:00100000:3.0:1787764796.371110:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222032000 00000100:00100000:3.0:1787764796.371117:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222032000 00000100:00100000:3.0:1787764796.371150:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787764796.371157:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf755a47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+10:5784:x1874607222032000:12345-0@lo:101: 00010000:00010000:3.0:1787764796.371167:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764796.371180:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2129 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764796.371200:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764796.371210:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764796.371218:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ed86982, rc 0) 00000100:00100000:3.0:1787764796.371260:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf755a47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:5784:x1874607222032000:12345-0@lo:101: Request processed in 103us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764796.371266:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787764796.371339:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032000:0@lo:101: 00010000:00010000:2.0:1787764796.371352:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.371360:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764796.371419:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032128:0@lo:501: 00000100:00100000:2.0:1787764796.371446:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764796.371465:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ce09dae going to sleep for 11 seconds 00000100:00100000:3.0:1787764796.371509:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222032128 00000100:00100000:3.0:1787764796.371513:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222032128 00000100:00100000:3.0:1787764796.371527:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787764796.371531:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009193db16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:5784:x1874607222032128:12345-0@lo:501: 00000100:00100000:3.0:1787764796.372105:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009193db16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:5784:x1874607222032128:12345-0@lo:501: Request processed in 572us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764796.372112:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787764796.372223:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032128:0@lo:501: 00000100:00100000:2.0:1787764796.372253:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032256:0@lo:503: 00000100:00100000:2.0:1787764796.372291:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764796.372321:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ce09dae going to sleep for 11 seconds 00000100:00100000:3.0:1787764796.372371:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222032256 00000100:00100000:3.0:1787764796.372376:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222032256 00000100:00100000:3.0:1787764796.372395:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787764796.372408:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9116b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:5784:x1874607222032256:12345-0@lo:503: 00000040:00080000:3.0:1787764796.372440:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787764796.372483:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9116b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:5784:x1874607222032256:12345-0@lo:503: Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764796.372489:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787764796.372684:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032256:0@lo:503: 00000040:00080000:2.0:1787764796.373615:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787764796.374013:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787764796.374033:0:5784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787764796.374039:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764796.374050:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764796.374103:0:5784:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787764796.374106:0:5784:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90dc85d67000 10000000:01000000:3.0:1787764796.374108:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90dc85d67000 10000000:01000000:3.0:1787764796.374112:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787764796.374118:0:5784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dc85d67000 from 1 10000000:01000000:3.0:1787764796.374120:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764796.374148:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764796.374156:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764796.374164:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764796.374178:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032384:0@lo:101: 00000100:00100000:3.0:1787764796.374226:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764796.374273:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d603fea going to sleep for 11 seconds 00000100:00100000:2.0:1787764796.374400:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222032384 00000100:00100000:2.0:1787764796.374406:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222032384 00000100:00100000:2.0:1787764796.374434:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787764796.374442:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a71d7e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:5784:x1874607222032384:12345-0@lo:101: 00010000:00010000:2.0:1787764796.374452:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764796.374464:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2137 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.374483:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.374503:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.374512:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d006ea4, rc 0) 00000100:00100000:2.0:1787764796.374567:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a71d7e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5784:x1874607222032384:12345-0@lo:101: Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764796.374573:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787764796.374713:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032384:0@lo:101: 00010000:00010000:3.0:1787764796.374725:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764796.374733:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764796.374775:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032512:0@lo:501: 00000100:00100000:3.0:1787764796.374798:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764796.374824:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d603fea going to sleep for 11 seconds 00000100:00100000:2.0:1787764796.374864:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222032512 00000100:00100000:2.0:1787764796.374868:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222032512 00000100:00100000:2.0:1787764796.374885:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787764796.374890:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016fb02db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5784:x1874607222032512:12345-0@lo:501: 00000100:00100000:2.0:1787764796.375146:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016fb02db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5784:x1874607222032512:12345-0@lo:501: Request processed in 255us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764796.375153:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787764796.375322:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032512:0@lo:501: 00000100:00100000:3.0:1787764796.375348:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032640:0@lo:503: 00000100:00100000:3.0:1787764796.375382:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764796.375468:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d603fea going to sleep for 11 seconds 00000100:00100000:2.0:1787764796.375505:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222032640 00000100:00100000:2.0:1787764796.375509:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222032640 00000100:00100000:2.0:1787764796.375539:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787764796.375544:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e42cad23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5784:x1874607222032640:12345-0@lo:503: 00000100:00100000:2.0:1787764796.375854:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e42cad23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5784:x1874607222032640:12345-0@lo:503: Request processed in 309us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764796.375862:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787764796.376106:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222032640:0@lo:503: 00000100:00100000:3.0:1787764796.376374:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:5832:1874607222032768:0@lo:502: 00000100:00100000:3.0:1787764796.376424:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764796.376453:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c538c191 going to sleep for 11 seconds 00000100:00100000:2.0:1787764796.376548:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222032768 00000100:00100000:2.0:1787764796.376564:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222032768 00000100:00100000:2.0:1787764796.376617:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787764796.376624:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026f28949 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5832:x1874607222032768:12345-0@lo:502: 00000100:00100000:2.0:1787764796.376841:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026f28949 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5832:x1874607222032768:12345-0@lo:502: Request processed in 218us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764796.376854:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787764796.376890:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b9ad78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:5832:1874607222032768:0@lo:502: 00000020:01000004:2.0:1787764796.376942:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787764796.376957:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000845e7a19) 00000020:00000080:2.0:1787764796.376976:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787764796.377047:0:5832:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a5ed8383 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787764796.377052:0:5832:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a5ed8383 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787764796.377054:0:5832:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a5ed8383 4 00010000:00080000:2.0:1787764796.377081:0:5832:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ddb74f35@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.145@tcp at head 00010000:00010000:2.0:1787764796.378753:0:5832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787764796.382828:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787764796.382877:0:5832:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787764796.382890:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3ec49d1dfa4e214c 00000100:00080000:3.0:1787764796.382901:0:5832:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787764796.382906:0:5832:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ddb74f35 using connection 192.168.202.145@tcp/0@lo 00000100:00100000:3.0:1787764796.382941:0:5832:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000469b042e x1874607222032896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787764796.382976:0:5832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787764796.383289:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000469b042e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874607222032896:0@lo:38: 00000100:00100000:0.0:1787764796.383357:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764796.384701:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222032896 00000100:00100000:3.0:1787764796.384714:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222032896 00000100:00100000:3.0:1787764796.384766:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787764796.384773:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000530d2f31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1874607222032896:12345-0@lo:38: 00000100:00100000:3.0:1787764796.384850:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000530d2f31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1874607222032896:12345-0@lo:38: Request processed in 76us (1493us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787764796.384858:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787764796.384968:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007776904f pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:5832:1874607222033024:0@lo:502: 00000100:00100000:3.0:1787764796.385018:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764796.385377:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222033024 00000100:00100000:2.0:1787764796.385383:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222033024 00000100:00100000:2.0:1787764796.385429:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787764796.385436:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000129d8ea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5832:x1874607222033024:12345-0@lo:502: 00000100:00100000:2.0:1787764796.385666:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000129d8ea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5832:x1874607222033024:12345-0@lo:502: Request processed in 230us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764796.385673:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787764796.385777:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787764796.385785:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000ddb74f35 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787764796.385789:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787764796.385792:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000469b042e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874607222032896:0@lo:38: 00000100:00100000:3.0:1787764796.386896:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026dfa9d8 going to sleep for 11 seconds 00000100:00100000:3.0:1787764796.386921:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007776904f pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:5832:1874607222033024:0@lo:502: 00000040:00080000:3.0:1787764796.386952:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787764796.387081:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787764796.387101:0:5784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764796.387123:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764796.387134:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787764796.387185:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787764796.387188:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787764796.387189:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764796.387195:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764796.387196:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764796.387198:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764796.387199:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787764796.387200:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787764796.387201:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764796.387202:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764796.387204:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764796.387205:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787764796.387208:0:5784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787764796.387210:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787764796.387211:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787764796.387212:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764796.387213:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764796.387214:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764796.387215:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764796.387215:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787764796.387216:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787764796.387217:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764796.387218:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764796.387219:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764796.387220:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787764796.387240:0:5784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787764796.387253:0:5784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222033152:0@lo:253: 00000100:00100000:2.0:1787764796.387323:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764796.387352:0:5784:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c4d9f46 going to sleep for 11 seconds 00000100:00100000:3.0:1787764796.387569:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222033152 00000100:00100000:3.0:1787764796.387576:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222033152 00000100:00100000:3.0:1787764796.387659:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787764796.387668:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fc7b624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:5784:x1874607222033152:12345-0@lo:253: 20000000:01000000:3.0:1787764796.387694:0:5796:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787764796.387707:0:5796:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787764796.459674:0:5796:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787764796.459724:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787764796.459864:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787764796.459869:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787764796.459887:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.459905:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.459913:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.459951:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.459966:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 12 pid: 5796 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764796.459992:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020c33529 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874607222033280:0@lo:104: 00000100:00100000:0.0:1787764796.460059:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764796.460164:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093d9003e going to sleep for 11 seconds 00000100:00100000:3.0:1787764796.460306:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222033280 00000100:00100000:3.0:1787764796.460312:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222033280 00000100:00100000:3.0:1787764796.460396:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787764796.460406:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023b6f320 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:5819:x1874607222033280:12345-0@lo:104: 00010000:00010000:3.0:1787764796.460416:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764796.460490:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787764796.460496:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023b6f320 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:5819:x1874607222033280:12345-0@lo:104: Request processed in 92us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764796.460503:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764796.460578:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020c33529 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874607222033280:0@lo:104: 00010000:00010000:2.0:1787764796.460623:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.460683:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764796.460688:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.460695:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c13c41cc already unused, calling callback (000000005b089f10) 10000000:00010000:0.0:1787764796.460698:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.460706:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764796.460713:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764796.460719:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764796.460893:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.460900:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764796.460918:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.460924:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: 00000000c13c41cc/0x3ec49d1dfa4e211b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2122 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.460940:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764796.460948:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764796.460949:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764796.461004:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003541b9ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222033408:0@lo:103: 00000100:00100000:0.0:1787764796.461032:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764796.461096:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222033408 00000100:00100000:0.0:1787764796.461099:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222033408 00010000:00010000:0.0:1787764796.461115:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 13 pid: 5796 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764796.461136:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787764796.461141:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9672502 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+13:3287:x1874607222033408:12345-0@lo:103: 00010000:00010000:0.0:1787764796.461149:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764796.461152:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 13 pid: 5796 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461160:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 13 pid: 5796 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461170:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e211b expref: 13 pid: 5796 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461192:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461199:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787764796.461208:0:5788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001340531s 00010000:00010000:0.0:1787764796.461212:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461227:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461233:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461238:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461243:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ed02aafb already unused, calling callback (000000004b21288f) 00010000:00010000:0.0:1787764796.461247:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461253:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461266:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461276:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764796.461304:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9672502 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+12:3287:x1874607222033408:12345-0@lo:103: Request processed in 163us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764796.461310:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787764796.461339:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003541b9ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222033408:0@lo:103: 00010000:00010000:0.0:1787764796.461355:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461361:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764796.461376:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ed02aafb/0x3ec49d1dfa4e2153 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764796.475413:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fc7b624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:5784:x1874607222033152:12345-0@lo:253: Request processed in 87738us (88082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764796.475428:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787764796.477340:0:5784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000043db50f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:5784:1874607222033152:0@lo:253: 10000000:01000000:2.0:1787764796.477362:0:5784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787764796.477365:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787764796.477367:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787764796.477368:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764796.477370:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764796.477386:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764796.477387:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764796.477388:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787764796.477390:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787764796.477391:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764796.477392:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764796.477394:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764796.477395:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787764796.477412:0:5784:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787764796.482267:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.482725:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787764796.482935:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.483124:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787764796.483345:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.483529:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787764796.485420:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.485694:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787764796.485892:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.486069:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787764796.486336:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764796.486526:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787764796.516823:0:5784:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787764796.571529:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787764796.571818:0:5838:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787764796.575281:0:5837:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787764796.575291:0:5837:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787764796.585754:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787764796.586120:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787764796.586614:0:5784:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787764796.586622:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787764796.586764:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764796.600758:0:5784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787764796.604924:0:5784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787764796.604986:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787764796.606259:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787764796.606475:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787764796.607451:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787764796.607573:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787764796.607693:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787764796.607786:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787764796.607883:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787764796.608001:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787764796.608081:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787764796.608171:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787764796.608297:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787764796.608403:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787764796.608496:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000040:00080000:2.0:1787764796.614527:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1787764796.616156:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787764796.616405:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787764796.616509:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787764796.616791:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787764796.616953:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787764796.617246:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787764796.617374:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787764796.617500:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787764796.617694:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787764796.617845:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787764796.617987:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787764796.618085:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787764796.618183:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787764796.618266:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787764796.618368:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787764796.618470:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787764796.618635:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787764796.618734:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787764796.618828:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787764796.618929:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787764796.619054:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787764796.619172:0:5784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787764796.648710:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787764796.648793:0:5838:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787764796.648797:0:5838:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787764796.686049:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787764796.758636:0:5784:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787764796.758672:0:5784:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb68ec1b0b988 00100000:10000000:3.0:1787764796.758680:0:5784:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787764796.761921:0:5784:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787764796.761944:0:5784:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787764796.762148:0:5784:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787764796.762241:0:5784:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787764797.717185:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764798.735242:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764799.757949:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787764800.328507:0:6081:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787764800.781999:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764801.486215:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091b05ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222033536:0@lo:400: 00000100:00100000:1.0:1787764801.486283:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764801.486349:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222033536 00000100:00100000:2.0:1787764801.486356:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222033536 00000100:00100000:2.0:1787764801.486402:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787764801.486410:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d119ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+11:3288:x1874607222033536:12345-0@lo:400: 00000100:00080000:0.0:1787764801.486559:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787764801.486564:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787764801.486567:0:38:0:(import.c:65:import_set_state_nolock()) 00000000ddb74f35 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787764801.486574:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ddb74f35 using connection 192.168.202.145@tcp/0@lo 00000100:00100000:0.0:1787764801.486616:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003541b9ac x1874607222033664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787764801.486646:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003541b9ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874607222033664:0@lo:38: 00000100:00100000:0.0:1787764801.486690:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764801.486745:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222033664 00000100:00100000:0.0:1787764801.486750:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222033664 00000100:00100000:0.0:1787764801.486769:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787764801.486773:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020c33529 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1874607222033664:12345-0@lo:38: 00010000:00080000:0.0:1787764801.486793:0:5805:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 111 last 0 00000020:00000080:0.0:1787764801.486827:0:5805:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3ec49d1dfa4e215a 00000004:00100000:0.0:1787764801.486867:0:5805:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787764801.486998:0:5805:0:(import.c:65:import_set_state_nolock()) 000000002f1d451d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787764801.487036:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020c33529 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874607222033664:12345-0@lo:38: Request processed in 261us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764801.487055:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787764801.487088:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003541b9ac x1874607222033664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787764811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787764801.487103:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787764801.487109:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787764801.487113:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787764801.487115:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000ddb74f35 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787764801.487120:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003541b9ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874607222033664:0@lo:38: 00000100:00100000:2.0:1787764801.489897:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d119ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+11:3288:x1874607222033536:12345-0@lo:400: Request processed in 3483us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764801.489923:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787764801.490089:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091b05ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222033536:0@lo:400: 00010000:00010000:3.0:1787764801.805769:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764802.829764:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787764803.533694:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787764803.533702:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90dc85d67000 from 3 10000000:01000000:2.0:1787764803.533707:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787764803.533750:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 00000000dffad3f5/0x3ec49d1dfa4e2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764803.533761:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 00000000dffad3f5/0x3ec49d1dfa4e2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764803.533771:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 00000000dffad3f5/0x3ec49d1dfa4e2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764803.533792:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b93b92b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222033792:0@lo:101: 00000100:00100000:2.0:1787764803.533854:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764803.533925:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d8db8c2 going to sleep for 11 seconds 00000100:00100000:1.0:1787764803.534007:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222033792 00000100:00100000:1.0:1787764803.534014:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222033792 00000100:00100000:1.0:1787764803.534058:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787764803.534064:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004307864 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:5800:x1874607222033792:12345-0@lo:101: 00010000:00010000:1.0:1787764803.534075:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764803.534086:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2161 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764803.534107:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764803.534144:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fb581fa/0x3ec49d1dfa4e2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764803.534154:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fb581fa, rc 0) 00000100:00100000:1.0:1787764803.534192:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004307864 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222033792:12345-0@lo:101: Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764803.534199:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787764803.534278:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b93b92b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222033792:0@lo:101: 00010000:00010000:2.0:1787764803.534289:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 00000000dffad3f5/0x3ec49d1dfa4e2161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764803.534297:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 00000000dffad3f5/0x3ec49d1dfa4e2161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764803.534336:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b93b92b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222033920:0@lo:256: 00000100:00100000:2.0:1787764803.534361:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764803.534379:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d8db8c2 going to sleep for 11 seconds 00000100:00100000:0.0:1787764803.534440:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222033920 00000100:00100000:0.0:1787764803.534445:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222033920 00000100:00100000:0.0:1787764803.534472:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764803.534478:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbb53930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222033920:12345-0@lo:256: 20000000:01000000:0.0:1787764803.534569:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787764803.534621:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787764803.534625:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787764803.534696:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbb53930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222033920:12345-0@lo:256: Request processed in 218us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764803.534703:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764803.534729:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b93b92b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222033920:0@lo:256: 10000000:01000000:0.0:1787764803.534762:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787764803.534767:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 00000000dffad3f5/0x3ec49d1dfa4e2161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764803.534773:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 00000000dffad3f5/0x3ec49d1dfa4e2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764803.853727:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787764804.759337:0:6284:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa14e5c90 20000000:00000080:0.0:1787764804.759353:0:6284:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90dcbe528000 uarg=0000000000000000 20000000:01000000:0.0:1787764804.759378:0:6284:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787764804.759384:0:6284:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787764804.759388:0:6284:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787764804.759842:0:6284:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787764804.759853:0:6284:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787764804.762518:0:6284:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787764804.762956:0:6284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787764804.763083:0:6284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787764804.763198:0:6284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787764804.763214:0:6284:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787764804.763231:0:6284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764804.763249:0:6284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764804.763256:0:6284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764804.763292:0:6284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764804.763306:0:6284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 11 pid: 5797 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764804.763319:0:6284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000448f6f47 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6284:1874607222034048:0@lo:104: 00000100:00100000:0.0:1787764804.763377:0:6284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764804.763500:0:6284:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5b23e4d going to sleep for 11 seconds 00000100:00100000:1.0:1787764804.764068:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222034048 00000100:00100000:1.0:1787764804.764075:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222034048 00000100:00100000:1.0:1787764804.764212:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787764804.764222:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000849f6609 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:6284:x1874607222034048:12345-0@lo:104: 00010000:00010000:1.0:1787764804.764234:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764804.764297:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764804.764304:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000849f6609 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:6284:x1874607222034048:12345-0@lo:104: Request processed in 83us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764804.764311:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787764804.764355:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787764804.764360:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764374:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006cdb481e already unused, calling callback (000000005b089f10) 10000000:00010000:2.0:1787764804.764377:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764384:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764804.764390:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764804.764396:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787764804.764432:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764441:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764804.764457:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764463:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: 000000006cdb481e/0x3ec49d1dfa4e2129 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2130 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764489:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764804.764491:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764804.764493:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764804.764510:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081799610 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222034176:0@lo:103: 00000100:00100000:2.0:1787764804.764541:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764804.764608:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222034176 00000100:00100000:2.0:1787764804.764613:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222034176 00010000:00010000:2.0:1787764804.764628:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 12 pid: 5797 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764804.764667:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764804.764684:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d5b1f39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+12:3289:x1874607222034176:12345-0@lo:103: 00010000:00010000:2.0:1787764804.764694:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764804.764698:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 12 pid: 5797 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764707:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 12 pid: 5797 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764720:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764727:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764740:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764746:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764752:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764757:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764762:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000e2ceecc already unused, calling callback (000000004b21288f) 00010000:00010000:2.0:1787764804.764765:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764779:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764786:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764804.764795:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764804.764822:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d5b1f39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+12:3289:x1874607222034176:12345-0@lo:103: Request processed in 149us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764804.764828:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764804.764861:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081799610 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222034176:0@lo:103: 00010000:00010000:3.0:1787764804.764946:0:6284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ed86982/0x3ec49d1dfa4e2130 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2129 expref: 11 pid: 5797 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764804.764957:0:6284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000448f6f47 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6284:1874607222034048:0@lo:104: 00010000:00010000:3.0:1787764804.764969:0:6284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764804.764976:0:6284:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764804.764994:0:6284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764804.764999:0:6284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e2ceecc/0x3ec49d1dfa4e216f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764804.878361:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764805.901763:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764806.605771:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091b05ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222034304:0@lo:400: 00000100:00100000:1.0:1787764806.605780:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000448f6f47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222034432:0@lo:400: 00000100:00100000:1.0:1787764806.606968:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764806.608741:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764806.608840:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222034432 00000100:00100000:2.0:1787764806.608849:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222034432 00000100:00100000:2.0:1787764806.608903:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764806.608911:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094a034ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222034432:12345-0@lo:400: 00000100:00100000:2.0:1787764806.608967:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094a034ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222034432:12345-0@lo:400: Request processed in 57us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764806.608974:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787764806.609014:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000448f6f47 x1874607222034432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764806.609029:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000448f6f47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222034432:0@lo:400: 00000100:00100000:0.0:1787764806.612531:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222034304 00000100:00100000:0.0:1787764806.612547:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222034304 00000100:00100000:0.0:1787764806.612629:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787764806.612639:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044f947be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+11:3286:x1874607222034304:12345-0@lo:400: 00000100:00100000:0.0:1787764806.612742:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044f947be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+11:3286:x1874607222034304:12345-0@lo:400: Request processed in 105us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764806.612750:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787764806.612831:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091b05ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222034304:0@lo:400: 00010000:00010000:0.0:1787764806.929650:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764807.949729:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764808.974963:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787764809.480718:0:6646:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787764809.480727:0:6646:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787764809.480853:0:6646:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e88929d3 00000020:01000004:2.0:1787764809.480869:0:6646:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787764809.480880:0:6646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787764809.480890:0:6646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000008ab2635c) 00000020:00000080:2.0:1787764809.480903:0:6646:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787764809.491331:0:6646:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787764809.491654:0:6646:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787764809.504788:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787764809.508418:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787764809.508463:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787764809.508521:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787764809.508546:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787764809.508886:0:6646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787764809.508896:0:6646:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787764809.508905:0:6646:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3ec49d1dfa4e217d 00000020:01000004:2.0:1787764809.508912:0:6646:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787764809.508932:0:6646:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787764809.508934:0:6646:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787764809.508939:0:6646:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787764809.508943:0:6646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787764809.508952:0:6646:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000e9a5df2b) 00000020:00000080:2.0:1787764809.508961:0:6646:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787764809.509997:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787764809.510129:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787764809.510134:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787764809.511165:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787764809.511173:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787764809.511338:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787764809.511345:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787764809.512730:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764809.512903:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787764809.512909:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787764809.513270:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787764809.513279:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787764809.525471:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764809.525702:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787764809.525709:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787764809.527009:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787764809.527018:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787764809.528214:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787764809.528223:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787764809.530634:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764809.530825:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787764809.530836:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787764809.531738:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787764809.531745:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787764809.556775:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787764809.556937:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787764809.556943:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787764809.557763:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787764809.557771:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787764809.558040:0:6646:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787764809.558063:0:6646:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787764809.558069:0:6646:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787764809.569728:0:6646:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787764809.569758:0:6646:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.145@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787764809.569760:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787764809.569762:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787764809.569763:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764809.569763:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787764809.569764:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764809.569765:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764809.569766:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787764809.569767:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787764809.569767:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787764809.569768:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764809.569769:0:6646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787764809.569771:0:6646:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787764809.569773:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787764809.569773:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787764809.569774:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764809.569775:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787764809.569775:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764809.569776:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764809.569776:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787764809.569777:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787764809.569778:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787764809.569778:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764809.569779:0:6646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787764809.569799:0:6646:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787764809.569811:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000192ad04d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222034560:0@lo:253: 00000100:00100000:3.0:1787764809.569870:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764809.569911:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222034560 00000100:00100000:3.0:1787764809.569912:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000142f9b6f going to sleep for 11 seconds 00000100:00100000:1.0:1787764809.569919:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222034560 00000100:00100000:1.0:1787764809.569972:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787764809.569983:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e379ee41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222034560:12345-0@lo:253: 20000000:01000000:1.0:1787764809.570019:0:5796:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787764809.570029:0:5796:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787764809.570034:0:5796:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787764809.570037:0:5796:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787764809.570827:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787764809.571006:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787764809.571021:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787764809.571058:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787764809.571066:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787764809.571093:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787764809.571141:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787764809.571484:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787764809.571501:0:5796:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.145@tcp 20000000:01000000:1.0:1787764809.571503:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.145@tcp (null) (null) (null) 00000040:00080000:1.0:1787764809.571536:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787764809.571545:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787764809.571635:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787764809.571644:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.145@tcp (null) (null) 00000040:00080000:1.0:1787764809.571679:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787764809.571688:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787764809.571716:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787764809.571763:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787764809.572405:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787764809.572419:0:5796:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.145@tcp 20000000:01000000:1.0:1787764809.572421:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.145@tcp (null) (null) (null) 00000040:00080000:1.0:1787764809.572471:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787764809.572478:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787764809.572510:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787764809.572516:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.145@tcp (null) (null) 00000040:00080000:1.0:1787764809.572545:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787764809.572550:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787764809.572566:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787764809.572601:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787764809.572620:0:5796:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787764809.572622:0:5796:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787764809.572625:0:5796:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787764809.572632:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787764809.572634:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787764809.572653:0:5796:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787764809.572655:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787764809.573531:0:6661:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787764809.573559:0:6661:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787764809.573606:0:6661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787764809.573809:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787764809.573835:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787764809.573885:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787764809.573895:0:5796:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787764809.573896:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787764809.574153:0:6662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1787764809.574195:0:6662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1787764809.574250:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787764809.574384:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787764809.574405:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787764809.574422:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787764809.574428:0:5796:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787764809.574429:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787764809.574712:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787764809.574858:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787764809.574894:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787764809.574951:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787764809.574967:0:5796:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787764809.574969:0:5796:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787764809.574976:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787764809.575006:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.575021:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.575028:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.575034:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.575041:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.575077:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.575089:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 11 pid: 5797 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.575101:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae6410e7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1874607222034688:0@lo:104: 00000100:00100000:3.0:1787764809.575145:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764809.575186:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.575193:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222034688 00010000:00010000:3.0:1787764809.575196:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 11 pid: 5798 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.575201:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222034688 00000100:00100000:3.0:1787764809.575208:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073b5a91d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1874607222034816:0@lo:104: 00000100:00100000:3.0:1787764809.575233:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764809.575251:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222034816 00000100:00100000:0.0:1787764809.575256:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222034816 00000100:00100000:1.0:1787764809.575263:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787764809.575274:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058f5355e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+4:5796:x1874607222034688:12345-0@lo:104: 00010000:00010000:3.0:1787764809.575274:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.575288:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.575289:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 11 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.575309:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1874607222034944:0@lo:104: 00000100:00100000:3.0:1787764809.575342:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764809.575357:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764809.575364:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058f5355e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+4:5796:x1874607222034688:12345-0@lo:104: Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764809.575369:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9eed611 going to sleep for 11 seconds 00000100:00100000:1.0:1787764809.575374:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787764809.575387:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787764809.575390:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222034944 00000100:00100000:3.0:1787764809.575391:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae6410e7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1874607222034688:0@lo:104: 00000100:00100000:0.0:1787764809.575396:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222034944 00000100:00100000:1.0:1787764809.575399:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787764809.575404:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764809.575409:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b64b150f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+4:5796:x1874607222034816:12345-0@lo:104: 00010000:00010000:1.0:1787764809.575419:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575421:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f7206cd1 already unused, calling callback (000000005b089f10) 10000000:00010000:2.0:1787764809.575427:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575452:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764809.575459:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764809.575465:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787764809.575470:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764809.575475:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b64b150f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+4:5796:x1874607222034816:12345-0@lo:104: Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764809.575485:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787764809.575500:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.575501:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073b5a91d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1874607222034816:0@lo:104: 00010000:00010000:0.0:1787764809.575508:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787764809.575510:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787764809.575517:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787764809.575522:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092e709cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:5796:x1874607222034944:12345-0@lo:104: 00010000:00010000:1.0:1787764809.575529:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575538:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575547:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: 00000000f7206cd1/0x3ec49d1dfa4e2137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e213e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.575555:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1787764809.575561:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787764809.575563:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787764809.575568:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092e709cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:5796:x1874607222034944:12345-0@lo:104: Request processed in 49us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764809.575569:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bf62728 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222035072:0@lo:103: 00010000:00010000:2.0:1787764809.575569:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764809.575602:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787764809.575614:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000048a8913c already unused, calling callback (000000005b089f10) 10000000:00010000:2.0:1787764809.575617:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575632:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764809.575638:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.575647:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1787764809.575649:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787764809.575658:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1874607222034944:0@lo:104: 00010000:00010000:2.0:1787764809.575668:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575675:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764809.575684:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575689:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: 0000000048a8913c/0x3ec49d1dfa4e20ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e20b2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.575698:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764809.575699:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575702:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764809.575704:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000847efb61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222035200:0@lo:103: 00010000:00010000:1.0:1787764809.575706:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575706:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764809.575710:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764809.575722:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000828cc297 already unused, calling callback (000000005b089f10) 10000000:00010000:1.0:1787764809.575724:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.575729:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222035072 00010000:00010000:1.0:1787764809.575730:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.575735:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222035072 10000000:00010000:1.0:1787764809.575739:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.575742:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787764809.575750:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764809.575757:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 12 pid: 5797 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.575773:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.575781:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787764809.575781:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222035200 00000100:00100000:3.0:1787764809.575786:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222035200 00000100:00100000:2.0:1787764809.575799:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787764809.575799:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 13 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.575809:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764809.575814:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091b05ddb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+13:3289:x1874607222035072:12345-0@lo:103: 00000100:00100000:3.0:1787764809.575818:0:5790:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787764809.575825:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000231b99b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222035328:0@lo:103: 00010000:00010000:1.0:1787764809.575826:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: 00000000828cc297/0x3ec49d1dfa4e20c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e20ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.575830:0:5790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787764809.575839:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764809.575847:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 13 pid: 5797 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.575852:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764809.575860:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 13 pid: 5797 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.575867:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764809.575869:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764809.575874:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764809.575884:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764809.575887:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764809.575892:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e213e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2137 expref: 13 pid: 5797 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.575905:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764809.575941:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091b05ddb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+12:3289:x1874607222035072:12345-0@lo:103: Request processed in 133us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.575949:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787764809.575962:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bf62728 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222035072:0@lo:103: 00000100:00100000:2.0:1787764809.575967:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222035328 00000100:00100000:2.0:1787764809.575972:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222035328 00010000:00010000:2.0:1787764809.575987:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 12 pid: 5798 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.576004:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764809.576016:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764809.576016:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000448f6f47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+12:3289:x1874607222035200:12345-0@lo:103: 00000100:00100000:2.0:1787764809.576029:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da7115c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+12:3286:x1874607222035328:12345-0@lo:103: 00010000:00010000:3.0:1787764809.576037:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764809.576038:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764809.576045:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 12 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.576046:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 12 pid: 5798 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576062:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 12 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.576079:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 12 pid: 5798 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576093:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003d08b794/0x3ec49d1dfa4e20b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20ab expref: 12 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.576097:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000212d89d7/0x3ec49d1dfa4e20ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e20c7 expref: 12 pid: 5798 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576118:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576123:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.576133:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764809.576135:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576140:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576145:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576151:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576156:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000562995ba already unused, calling callback (000000004b21288f) 00010000:00010000:3.0:1787764809.576159:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576165:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764809.576168:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da7115c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+10:3286:x1874607222035328:12345-0@lo:103: Request processed in 142us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.576184:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787764809.576196:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.576205:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764809.576206:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000231b99b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222035328:0@lo:103: 00010000:00010000:1.0:1787764809.576219:0:5796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.576229:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.576236:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000562995ba/0x3ec49d1dfa4e218b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.576244:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000448f6f47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+9:3289:x1874607222035200:12345-0@lo:103: Request processed in 232us (506us total) trans 0 rc 0/0 20000000:01000000:1.0:1787764809.576249:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787764809.576254:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764809.576271:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000847efb61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222035200:0@lo:103: 00000100:00100000:1.0:1787764809.587035:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e379ee41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+8:6646:x1874607222034560:12345-0@lo:253: Request processed in 17048us (17158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764809.587049:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787764809.587068:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000192ad04d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222034560:0@lo:253: 10000000:01000000:3.0:1787764809.587084:0:6646:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787764809.587087:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787764809.587099:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787764809.587101:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787764809.587102:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787764809.587103:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787764809.587104:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787764809.587106:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787764809.587107:0:6646:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787764809.587108:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787764809.587109:0:6646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787764809.587126:0:6646:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e88929d3 from lustre-OST0000 10000000:01000000:3.0:1787764809.587149:0:6646:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787764809.587152:0:6646:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787764809.587157:0:6646:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90dc97e31a48 local copy 10000000:01000000:3.0:1787764809.587160:0:6646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787764809.587189:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.587198:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.587205:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.587220:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000192ad04d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222035456:0@lo:101: 00000100:00100000:3.0:1787764809.587252:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.587295:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9607db3 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.587296:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222035456 00000100:00100000:2.0:1787764809.587303:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222035456 00000100:00100000:2.0:1787764809.587343:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787764809.587351:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c04b479f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+8:6646:x1874607222035456:12345-0@lo:101: 00010000:00010000:2.0:1787764809.587363:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764809.587374:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e2199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2192 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.587395:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e2199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2192 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.587405:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e2199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2192 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.587413:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d006ea4, rc 0) 00000100:00100000:2.0:1787764809.587464:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c04b479f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+9:6646:x1874607222035456:12345-0@lo:101: Request processed in 114us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.587472:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787764809.587484:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000192ad04d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222035456:0@lo:101: 00010000:00010000:3.0:1787764809.587494:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.587503:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.587580:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000192ad04d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222035584:0@lo:501: 00000100:00100000:3.0:1787764809.587620:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.587636:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9607db3 going to sleep for 11 seconds 00000100:00100000:1.0:1787764809.587646:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222035584 00000100:00100000:1.0:1787764809.587652:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222035584 00000100:00100000:1.0:1787764809.587677:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787764809.587682:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae2c8cc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+9:6646:x1874607222035584:12345-0@lo:501: 00000100:00100000:1.0:1787764809.587815:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae2c8cc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+9:6646:x1874607222035584:12345-0@lo:501: Request processed in 133us (194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787764809.587824:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787764809.587836:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000192ad04d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222035584:0@lo:501: 10000000:01000000:3.0:1787764809.587851:0:6646:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787764809.587880:0:6646:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787764809.587884:0:6646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.587890:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.587896:0:6646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.587913:0:6646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787764809.587928:0:6646:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90dc89161000 10000000:01000000:3.0:1787764809.587939:0:6646:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787764809.587941:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787764809.587944:0:6646:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90dc97e31a48 00010000:00010000:2.0:1787764809.587948:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764809.587948:0:6646:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787764809.587955:0:6646:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90dc97e31a48 from 1 00010000:00010000:2.0:1787764809.587961:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ed86982 already unused, calling callback (000000005b089f10) 10000000:00010000:2.0:1787764809.587965:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764809.587966:0:6646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787764809.587976:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.587982:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 000000000a33191b/0x3ec49d1dfa4e21a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764809.587984:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.587991:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 000000000a33191b/0x3ec49d1dfa4e21a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764809.588006:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764809.588020:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 000000000a33191b/0x3ec49d1dfa4e21a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.588027:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.588034:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000192ad04d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222035712:0@lo:101: 00010000:00010000:2.0:1787764809.588036:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764809.588061:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.588067:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787764809.588074:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: 000000002ed86982/0x3ec49d1dfa4e2192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ec49d1dfa4e2199 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.588088:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000847efb61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222035840:0@lo:103: 00000100:00100000:3.0:1787764809.588090:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab39aabf going to sleep for 11 seconds 00010000:00010000:2.0:1787764809.588091:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764809.588095:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764809.588098:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764809.588111:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222035712 00000100:00100000:2.0:1787764809.588116:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222035712 00000100:00100000:0.0:1787764809.588131:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764809.588146:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787764809.588156:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e2287fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+9:6646:x1874607222035712:12345-0@lo:101: 00000100:00100000:3.0:1787764809.588160:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222035840 00010000:00010000:2.0:1787764809.588164:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787764809.588166:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222035840 00010000:00010000:2.0:1787764809.588175:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f98bb2b9/0x3ec49d1dfa4e21a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e21a0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.588190:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f98bb2b9/0x3ec49d1dfa4e21a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21a0 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.588198:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f98bb2b9/0x3ec49d1dfa4e21a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21a0 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.588204:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f98bb2b9, rc 0) 00000100:00100000:3.0:1787764809.588206:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787764809.588214:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003541b9ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+11:3287:x1874607222035840:12345-0@lo:103: 00010000:00010000:3.0:1787764809.588223:0:6665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764809.588232:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d006ea4/0x3ec49d1dfa4e2199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2192 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.588241:0:6665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764809.588256:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e2287fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222035712:12345-0@lo:101: Request processed in 102us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.588264:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787764809.588284:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000192ad04d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222035712:0@lo:101: 00000100:00100000:3.0:1787764809.588291:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003541b9ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+9:3287:x1874607222035840:12345-0@lo:103: Request processed in 76us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764809.588299:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787764809.588300:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 000000000a33191b/0x3ec49d1dfa4e21a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21a7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764809.588308:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000847efb61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222035840:0@lo:103: 00010000:00010000:0.0:1787764809.588311:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 000000000a33191b/0x3ec49d1dfa4e21a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e21a7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764809.588334:0:6646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787764809.588345:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 000000000a33191b/0x3ec49d1dfa4e21a0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21a7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764809.588352:0:6646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 000000000a33191b/0x3ec49d1dfa4e21a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21a7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764809.588358:0:6646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787764809.588362:0:6646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787764809.588366:0:6646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787764809.588368:0:6646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787764809.588391:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 00000000b74e0fe0/0x3ec49d1dfa4e21ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764809.588399:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 00000000b74e0fe0/0x3ec49d1dfa4e21ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764809.588403:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 00000000b74e0fe0/0x3ec49d1dfa4e21ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.588410:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222035968:0@lo:101: 00000100:00100000:0.0:1787764809.588448:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764809.588462:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a24cff44 going to sleep for 11 seconds 00000100:00100000:1.0:1787764809.588481:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222035968 00000100:00100000:1.0:1787764809.588484:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222035968 00000100:00100000:1.0:1787764809.588503:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787764809.588508:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000239a4c33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+9:6646:x1874607222035968:12345-0@lo:101: 00010000:00010000:1.0:1787764809.588513:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764809.588520:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063cede2a/0x3ec49d1dfa4e21b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e21ae expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.588529:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063cede2a/0x3ec49d1dfa4e21b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.588534:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063cede2a/0x3ec49d1dfa4e21b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.588538:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063cede2a, rc 0) 00000100:00100000:1.0:1787764809.588560:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000239a4c33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222035968:12345-0@lo:101: Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764809.588564:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787764809.588603:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222035968:0@lo:101: 00010000:00010000:0.0:1787764809.588616:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 00000000b74e0fe0/0x3ec49d1dfa4e21ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764809.588624:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 00000000b74e0fe0/0x3ec49d1dfa4e21ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764809.588664:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036096:0@lo:501: 00000100:00100000:0.0:1787764809.588680:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764809.588697:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a24cff44 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.588719:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222036096 00000100:00100000:2.0:1787764809.588724:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222036096 00000100:00100000:2.0:1787764809.588752:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787764809.588759:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000473f5624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036096:12345-0@lo:501: 00000100:00100000:2.0:1787764809.588904:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000473f5624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036096:12345-0@lo:501: Request processed in 146us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.588912:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787764809.588927:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036096:0@lo:501: 00000100:00100000:0.0:1787764809.588953:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036224:0@lo:503: 00000100:00100000:0.0:1787764809.588983:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764809.589006:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a24cff44 going to sleep for 11 seconds 00000100:00100000:1.0:1787764809.589013:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222036224 00000100:00100000:1.0:1787764809.589018:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222036224 00000100:00100000:1.0:1787764809.589045:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787764809.589050:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d06e1b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036224:12345-0@lo:503: 00000100:00100000:1.0:1787764809.589153:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d06e1b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036224:12345-0@lo:503: Request processed in 103us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764809.589161:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787764809.589166:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036224:0@lo:503: 00000040:00080000:0.0:1787764809.589364:0:6646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787764809.589406:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036352:0@lo:502: 00000100:00100000:0.0:1787764809.589427:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764809.589459:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a24cff44 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.589465:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222036352 00000100:00100000:2.0:1787764809.589470:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222036352 00000100:00100000:2.0:1787764809.589499:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787764809.589506:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b44c112b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036352:12345-0@lo:502: 00000100:00100000:2.0:1787764809.589661:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b44c112b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036352:12345-0@lo:502: Request processed in 156us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.589668:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787764809.589677:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036352:0@lo:502: 00000040:00080000:0.0:1787764809.589855:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787764809.589891:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787764809.589924:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787764809.589965:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787764809.589994:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787764809.590011:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787764809.590023:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036480:0@lo:502: 00000100:00100000:0.0:1787764809.590052:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764809.590075:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a24cff44 going to sleep for 11 seconds 00000100:00100000:1.0:1787764809.590090:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222036480 00000100:00100000:1.0:1787764809.590094:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222036480 00000100:00100000:1.0:1787764809.590120:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787764809.590125:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b61e43e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036480:12345-0@lo:502: 00000100:00100000:1.0:1787764809.590208:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b61e43e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036480:12345-0@lo:502: Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764809.590214:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787764809.590220:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c77d418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036480:0@lo:502: 00000040:00080000:0.0:1787764809.590272:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787764809.590277:0:6646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787764809.590570:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787764809.590575:0:6666:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787764809.590579:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764809.590581:0:6666:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787764809.590609:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787764809.590628:0:6666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000eb19cea2) 00000020:00000080:0.0:1787764809.590646:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787764809.590652:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787764809.590712:0:6666:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e88929d3 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787764809.590718:0:6666:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787764809.590724:0:6666:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3ec49d1dfa4e21c3 00010000:00010000:0.0:1787764809.593740:0:6666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787764809.593910:0:6666:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787764809.595106:0:6666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787764809.595230:0:6666:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787764809.597669:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787764809.597919:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787764809.598746:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787764809.598755:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764809.598760:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764809.598762:0:6666:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787764809.598766:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764809.598769:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764809.598776:0:6666:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787764809.598780:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787764809.598782:0:6666:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787764809.598814:0:6666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764809.598817:0:6666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764809.598819:0:6666:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787764809.598822:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787764809.598881:0:6646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787764809.598904:0:6646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787764809.598917:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: 00000000b74e0fe0/0x3ec49d1dfa4e21ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.598925:0:6646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: 00000000b74e0fe0/0x3ec49d1dfa4e21ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764809.598930:0:6646:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dc89161000 from 1 10000000:01000000:3.0:1787764809.598938:0:6646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787764809.598964:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: 00000000db7186c2/0x3ec49d1dfa4e21ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.598971:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: 00000000db7186c2/0x3ec49d1dfa4e21ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.598980:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: 00000000db7186c2/0x3ec49d1dfa4e21ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.598997:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036608:0@lo:101: 00000100:00100000:3.0:1787764809.599050:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.599083:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04773ba going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.599096:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222036608 00000100:00100000:2.0:1787764809.599103:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222036608 00000100:00100000:2.0:1787764809.599144:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787764809.599153:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a40161b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+10:6646:x1874607222036608:12345-0@lo:101: 00010000:00010000:2.0:1787764809.599164:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764809.599176:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000af222b6d/0x3ec49d1dfa4e21d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e21ca expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.599196:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af222b6d/0x3ec49d1dfa4e21d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.599218:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000af222b6d/0x3ec49d1dfa4e21d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.599226:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000af222b6d, rc 0) 00000100:00100000:2.0:1787764809.599269:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a40161b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222036608:12345-0@lo:101: Request processed in 118us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.599277:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787764809.599293:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036608:0@lo:101: 00010000:00010000:3.0:1787764809.599304:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: 00000000db7186c2/0x3ec49d1dfa4e21ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.599310:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: 00000000db7186c2/0x3ec49d1dfa4e21ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.599381:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036736:0@lo:501: 00000100:00100000:3.0:1787764809.599404:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.599419:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04773ba going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.599458:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222036736 00000100:00100000:2.0:1787764809.599463:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222036736 00000100:00100000:2.0:1787764809.599493:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787764809.599499:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f862379 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222036736:12345-0@lo:501: 00000100:00100000:2.0:1787764809.599732:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f862379 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222036736:12345-0@lo:501: Request processed in 233us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.599740:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787764809.599761:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036736:0@lo:501: 00000100:00100000:3.0:1787764809.599784:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036864:0@lo:503: 00000100:00100000:3.0:1787764809.599823:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.599840:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04773ba going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.599859:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222036864 00000100:00100000:2.0:1787764809.599865:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222036864 00000100:00100000:2.0:1787764809.599892:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787764809.599899:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aa5bc0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222036864:12345-0@lo:503: 00000100:00100000:2.0:1787764809.600224:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aa5bc0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222036864:12345-0@lo:503: Request processed in 326us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.600232:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787764809.600251:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036864:0@lo:503: 00000040:00080000:3.0:1787764809.600446:0:6646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787764809.600509:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036992:0@lo:502: 00000100:00100000:3.0:1787764809.600546:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.600564:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04773ba going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.600611:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222036992 00000100:00100000:2.0:1787764809.600617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222036992 00000100:00100000:2.0:1787764809.600651:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787764809.600658:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c275a67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222036992:12345-0@lo:502: 00000100:00100000:2.0:1787764809.600808:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c275a67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222036992:12345-0@lo:502: Request processed in 150us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.600822:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787764809.600829:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222036992:0@lo:502: 00000040:00080000:3.0:1787764809.601163:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787764809.601219:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787764809.601241:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037120:0@lo:502: 00000100:00100000:3.0:1787764809.601279:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.601302:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c04773ba going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.601324:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222037120 00000100:00100000:2.0:1787764809.601329:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222037120 00000100:00100000:2.0:1787764809.601356:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787764809.601363:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000927c762d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222037120:12345-0@lo:502: 00000100:00100000:2.0:1787764809.601521:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000927c762d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222037120:12345-0@lo:502: Request processed in 159us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.601528:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787764809.601546:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e052bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037120:0@lo:502: 00000040:00080000:3.0:1787764809.601664:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787764809.601674:0:6646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787764809.601924:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787764809.601930:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764809.601932:0:6670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787764809.601936:0:6670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90dc89161000 00000020:00000080:3.0:1787764809.601939:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787764809.601977:0:6670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787764809.601981:0:6670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764809.601983:0:6670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787764809.601987:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787764809.602128:0:6646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787764809.602142:0:6646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764809.602152:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.602158:0:6646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764809.602187:0:6646:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787764809.602190:0:6646:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90dc89161000 10000000:01000000:1.0:1787764809.602192:0:6646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90dc89161000 10000000:01000000:1.0:1787764809.602195:0:6646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787764809.602199:0:6646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dc89161000 from 1 10000000:01000000:1.0:1787764809.602201:0:6646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787764809.602216:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.602224:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.602232:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764809.602244:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037248:0@lo:101: 00000100:00100000:1.0:1787764809.602274:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764809.602315:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.602322:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222037248 00000100:00100000:2.0:1787764809.602328:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222037248 00000100:00100000:2.0:1787764809.602363:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787764809.602373:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222037248:12345-0@lo:101: 00010000:00010000:2.0:1787764809.602382:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764809.602392:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e21d8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.602409:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.602418:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.602426:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940ce800, rc 0) 00000100:00100000:2.0:1787764809.602473:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037248:12345-0@lo:101: Request processed in 103us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.602482:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787764809.602501:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037248:0@lo:101: 00010000:00010000:3.0:1787764809.602514:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.602521:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.602571:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037376:0@lo:501: 00000100:00100000:3.0:1787764809.602619:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.602637:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbe5213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.602647:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222037376 00000100:00100000:2.0:1787764809.602652:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222037376 00000100:00100000:2.0:1787764809.602689:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787764809.602697:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037376:12345-0@lo:501: 00000100:00100000:2.0:1787764809.602838:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037376:12345-0@lo:501: Request processed in 140us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764809.602846:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037376:0@lo:501: 00000100:00100000:2.0:1787764809.602847:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787764809.602877:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037504:0@lo:503: 00000100:00100000:3.0:1787764809.602908:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.602923:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbe5213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.602935:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222037504 00000100:00100000:2.0:1787764809.602940:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222037504 00000100:00100000:2.0:1787764809.602962:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787764809.602968:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037504:12345-0@lo:503: 00000100:00100000:2.0:1787764809.603089:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037504:12345-0@lo:503: Request processed in 120us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.603096:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787764809.603101:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037504:0@lo:503: 00000040:00080000:3.0:1787764809.603230:0:6646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787764809.603264:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037632:0@lo:502: 00000100:00100000:3.0:1787764809.603297:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.603313:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbe5213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.603337:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222037632 00000100:00100000:2.0:1787764809.603342:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222037632 00000100:00100000:2.0:1787764809.603364:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787764809.603371:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037632:12345-0@lo:502: 00000100:00100000:2.0:1787764809.603508:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037632:12345-0@lo:502: Request processed in 136us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.603517:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787764809.603525:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037632:0@lo:502: 00000040:00080000:3.0:1787764809.603793:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787764809.603837:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787764809.603870:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787764809.603915:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787764809.603953:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787764809.604002:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787764809.604052:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787764809.604088:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787764809.604136:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787764809.604170:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787764809.604202:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787764809.604258:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787764809.604296:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787764809.604342:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787764809.604403:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787764809.604456:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787764809.604491:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787764809.604542:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787764809.604577:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787764809.604652:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787764809.604699:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787764809.604731:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787764809.604776:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787764809.604821:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787764809.604853:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787764809.604883:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787764809.604923:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787764809.604954:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787764809.604973:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037760:0@lo:502: 00000100:00100000:3.0:1787764809.605007:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.605034:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbe5213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.605056:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222037760 00000100:00100000:2.0:1787764809.605061:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222037760 00000100:00100000:2.0:1787764809.605081:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787764809.605087:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037760:12345-0@lo:502: 00000100:00100000:2.0:1787764809.605207:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222037760:12345-0@lo:502: Request processed in 119us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764809.605214:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787764809.605222:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222037760:0@lo:502: 00000040:00080000:3.0:1787764809.605282:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787764809.605290:0:6646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787764809.605574:0:6671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787764809.605624:0:6671:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90dcb7afced8) 00000020:00000080:3.0:1787764809.605639:0:6671:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787764809.605693:0:6671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90dc89161000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787764809.605696:0:6671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90dc89161000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787764809.605698:0:6671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90dc89161000 3 00010000:00080000:3.0:1787764809.605721:0:6671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90dcb7aed800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.145@tcp at head 00010000:00010000:3.0:1787764809.609364:0:6671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787764809.609512:0:6671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787764809.609540:0:6671:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787764809.609549:0:6671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3ec49d1dfa4e21ed 00000100:00080000:3.0:1787764809.609555:0:6671:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787764809.609558:0:6671:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90dcb7aed800 using connection 192.168.202.145@tcp/0@lo 00000100:00100000:3.0:1787764809.609580:0:6671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90dc996fd2c0 x1874607222037888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787764809.609652:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1874607222037888:0@lo:38: 00000100:00100000:3.0:1787764809.609693:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764809.609731:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222037888 00000100:00100000:0.0:1787764809.609739:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222037888 00000100:00080000:3.0:1787764809.609745:0:6671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787764809.609779:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787764809.609788:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1874607222037888:12345-0@lo:38: 00000100:00100000:3.0:1787764809.609815:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222038016:0@lo:400: 00010000:00080000:0.0:1787764809.609816:0:5803:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:0.0:1787764809.609856:0:5803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3ec49d1dfa4e21f4 00000100:00100000:3.0:1787764809.609861:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1787764809.609867:0:5803:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787764809.609896:0:5803:0:(import.c:65:import_set_state_nolock()) ffff90dcb7858000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787764809.609914:0:5805:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787764809.609927:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787764809.609947:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874607222037888:12345-0@lo:38: Request processed in 159us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764809.609956:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787764809.609967:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90dc996fd2c0 x1874607222037888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787764819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764809.609972:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222038016 00000100:00100000:0.0:1787764809.609977:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222038016 00000100:00100000:3.0:1787764809.609980:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787764809.609988:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787764809.609995:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787764809.609999:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787764809.610002:0:3285:0:(import.c:65:import_set_state_nolock()) ffff90dcb7aed800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787764809.610007:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1874607222037888:0@lo:38: 00000100:00100000:0.0:1787764809.610014:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787764809.610023:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222038016:12345-0@lo:400: 00000100:00100000:0.0:1787764809.610072:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222038016:12345-0@lo:400: Request processed in 50us (210us total) trans 0 rc 0/0 00010000:00080000:3.0:1787764809.610082:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90dc83c761c0 x1874607222038016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764809.610086:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787764809.610098:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222038016:0@lo:400: 00000040:00080000:2.0:1787764809.611858:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787764809.612825:0:6646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787764809.612850:0:6646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787764809.612871:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.612883:0:6646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787764809.612929:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787764809.612932:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787764809.612933:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764809.612934:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764809.612936:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764809.612937:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764809.612938:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764809.612940:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764809.612941:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764809.612943:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764809.612944:0:6646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787764809.612947:0:6646:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787764809.612950:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787764809.612951:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787764809.612952:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764809.612953:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764809.612954:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764809.612956:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764809.612956:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764809.612957:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764809.612958:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764809.612960:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764809.612960:0:6646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787764809.612979:0:6646:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787764809.612992:0:6646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222038144:0@lo:253: 00000100:00100000:1.0:1787764809.613044:0:6646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764809.613075:0:6646:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787764809.613079:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222038144 00000100:00100000:2.0:1787764809.613086:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222038144 00000100:00100000:2.0:1787764809.613124:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787764809.613135:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:6646:x1874607222038144:12345-0@lo:253: 20000000:01000000:2.0:1787764809.613158:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787764809.613168:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787764809.620791:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787764809.620807:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787764809.620817:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787764809.620823:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787764809.620850:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.620874:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.620884:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.620915:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764809.620930:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 12 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.620949:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874607222038272:0@lo:104: 00000100:00100000:3.0:1787764809.621009:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764809.621054:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbe5219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764809.621247:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222038272 00000100:00100000:0.0:1787764809.621253:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222038272 00000100:00100000:0.0:1787764809.621301:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787764809.621313:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+3:5819:x1874607222038272:12345-0@lo:104: 00010000:00010000:0.0:1787764809.621335:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc940cf800/0x3ec49d1dfa4e2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764809.621401:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787764809.621409:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+3:5819:x1874607222038272:12345-0@lo:104: Request processed in 99us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764809.621412:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874607222038272:0@lo:104: 00010000:00010000:2.0:1787764809.621414:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787764809.621424:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787764809.621425:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc940cf800/0x3ec49d1dfa4e2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.621447:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621453:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940cf800 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:2.0:1787764809.621459:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cf800/0x3ec49d1dfa4e2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621468:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc940cf800/0x3ec49d1dfa4e2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764809.621476:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cf800/0x3ec49d1dfa4e2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764809.621482:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787764809.621515:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc940cf800/0x3ec49d1dfa4e2161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621522:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764809.621547:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc940cf800/0x3ec49d1dfa4e2161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764809.621552:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222038400:0@lo:103: 00010000:00010000:2.0:1787764809.621568:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc940cf800/0x3ec49d1dfa4e2161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2168 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621607:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764809.621610:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764809.621615:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764809.621619:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764809.621656:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222038400 00000100:00100000:2.0:1787764809.621661:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222038400 00010000:00010000:2.0:1787764809.621681:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 13 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764809.621722:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787764809.621730:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+13:3289:x1874607222038400:12345-0@lo:103: 00010000:00010000:2.0:1787764809.621740:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764809.621745:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 13 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621756:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 13 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621769:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2161 expref: 13 pid: 5796 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621784:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621792:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787764809.621814:0:5789:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001340531s 00010000:00010000:2.0:1787764809.621819:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621825:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621832:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621839:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621845:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131000 already unused, calling callback (ffffffffc15ff530) 00010000:00010000:2.0:1787764809.621849:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621857:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621872:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764809.621881:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764809.621881:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764809.621913:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764809.621922:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+12:3289:x1874607222038400:12345-0@lo:103: Request processed in 191us (306us total) trans 0 rc 0/0 00010000:00010000:1.0:1787764809.621924:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc93131000/0x3ec49d1dfa4e21fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764809.621936:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787764809.621959:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222038400:0@lo:103: 00000100:00100000:3.0:1787764809.623018:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:6646:x1874607222038144:12345-0@lo:253: Request processed in 9885us (9973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764809.623027:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787764809.623049:0:6646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:6646:1874607222038144:0@lo:253: 10000000:01000000:1.0:1787764809.623058:0:6646:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787764809.623061:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787764809.623063:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787764809.623064:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764809.623066:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764809.623067:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764809.623068:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764809.623069:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764809.623071:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764809.623072:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764809.623074:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764809.623075:0:6646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787764809.623083:0:6646:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787764809.625329:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787764809.625446:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787764809.625654:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787764809.625819:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787764809.626003:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1787764809.626155:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787764809.626914:0:6646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787764809.704639:0:6646:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787764809.704646:0:6646:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787764809.704694:0:6646:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787764809.704745:0:6646:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787764809.704761:0:6646:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787764809.704785:0:6646:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787764809.997739:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764811.021736:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787764811.597654:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787764811.597663:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dc85d67000 from 21 10000000:01000000:3.0:1787764811.597669:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764811.597724:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764811.597736:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764811.597748:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764811.597768:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222038528:0@lo:101: 00000100:00100000:3.0:1787764811.597833:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764811.597910:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.598005:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222038528 00000100:00100000:2.0:1787764811.598012:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222038528 00000100:00100000:2.0:1787764811.598069:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787764811.598077:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+11:5800:x1874607222038528:12345-0@lo:101: 00010000:00010000:2.0:1787764811.598091:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764811.598103:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2202 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.598126:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.598137:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.598145:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940ce600, rc 0) 00000100:00100000:2.0:1787764811.598233:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222038528:12345-0@lo:101: Request processed in 156us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.598240:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787764811.598313:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222038528:0@lo:101: 00010000:00010000:3.0:1787764811.598327:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764811.598335:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764811.598386:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222038656:0@lo:501: 00000100:00100000:3.0:1787764811.598409:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764811.598458:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.598464:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222038656 00000100:00100000:2.0:1787764811.598468:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222038656 00000100:00100000:2.0:1787764811.598497:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787764811.598503:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222038656:12345-0@lo:501: 00000100:00100000:2.0:1787764811.598783:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222038656:12345-0@lo:501: Request processed in 279us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.598790:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787764811.598813:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222038656:0@lo:501: 00000100:00100000:3.0:1787764811.598839:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222038784:0@lo:503: 00000100:00100000:3.0:1787764811.598876:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764811.598898:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.598909:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222038784 00000100:00100000:2.0:1787764811.598913:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222038784 00000100:00100000:2.0:1787764811.598969:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787764811.598975:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222038784:12345-0@lo:503: 00000100:00100000:2.0:1787764811.599192:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222038784:12345-0@lo:503: Request processed in 216us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.599204:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787764811.599223:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222038784:0@lo:503: 00000100:00100000:0.0:1787764811.599489:0:6841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb783a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6841:1874607222038912:0@lo:502: 00000100:00100000:0.0:1787764811.599515:0:6841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764811.599560:0:6841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a511b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764811.599599:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222038912 00000100:00100000:1.0:1787764811.599602:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222038912 00000100:00100000:1.0:1787764811.599649:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787764811.599654:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:6841:x1874607222038912:12345-0@lo:502: 00000100:00100000:1.0:1787764811.599786:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:6841:x1874607222038912:12345-0@lo:502: Request processed in 131us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764811.599793:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787764811.599816:0:6841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb783a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6841:1874607222038912:0@lo:502: 00000100:00100000:3.0:1787764811.599858:0:6841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6841:1874607222039040:0@lo:502: 00000100:00100000:3.0:1787764811.599888:0:6841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764811.599908:0:6841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.599921:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222039040 00000100:00100000:2.0:1787764811.599925:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222039040 00000100:00100000:2.0:1787764811.600003:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787764811.600009:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:6841:x1874607222039040:12345-0@lo:502: 00000100:00100000:2.0:1787764811.600091:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:6841:x1874607222039040:12345-0@lo:502: Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.600098:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787764811.600121:0:6841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6841:1874607222039040:0@lo:502: 00000040:00080000:3.0:1787764811.600139:0:6841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787764811.600191:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787764811.600207:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764811.600213:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.600221:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764811.600229:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787764811.600232:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90dc85d67000 from 4 10000000:01000000:2.0:1787764811.600235:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787764811.600253:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.600259:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.600264:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764811.600271:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039168:0@lo:101: 00000100:00100000:2.0:1787764811.600292:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.600308:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcaf7da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764811.600344:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222039168 00000100:00100000:1.0:1787764811.600348:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222039168 00000100:00100000:1.0:1787764811.600392:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787764811.600396:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222039168:12345-0@lo:101: 00010000:00010000:1.0:1787764811.600401:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764811.600409:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2210 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.600432:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.600445:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.600452:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81676000, rc 0) 00000100:00100000:1.0:1787764811.600513:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222039168:12345-0@lo:101: Request processed in 116us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764811.600516:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787764811.600554:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039168:0@lo:101: 00010000:00010000:2.0:1787764811.600561:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.600567:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764811.600621:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039296:0@lo:256: 00000100:00100000:2.0:1787764811.600646:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.600721:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcaf7da3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764811.600729:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222039296 00000100:00100000:3.0:1787764811.600734:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222039296 00000100:00100000:3.0:1787764811.600761:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787764811.600767:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222039296:12345-0@lo:256: 20000000:01000000:3.0:1787764811.600778:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787764811.600791:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787764811.600793:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787764811.600866:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222039296:12345-0@lo:256: Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764811.600873:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787764811.600878:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039296:0@lo:256: 10000000:01000000:2.0:1787764811.600914:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787764811.600919:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.600927:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764811.600934:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787764811.600936:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787764811.600938:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787764811.601001:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.601009:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.601024:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764811.601031:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039424:0@lo:101: 00000100:00100000:2.0:1787764811.601048:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.601090:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcaf7da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764811.601115:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222039424 00000100:00100000:1.0:1787764811.601117:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222039424 00000100:00100000:1.0:1787764811.601140:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787764811.601146:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222039424:12345-0@lo:101: 00010000:00010000:1.0:1787764811.601152:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764811.601160:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e221e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.601173:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.601179:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.601183:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81676600, rc 0) 00000100:00100000:2.0:1787764811.601285:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039424:0@lo:101: 00000100:00100000:1.0:1787764811.601286:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222039424:12345-0@lo:101: Request processed in 139us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764811.601292:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1787764811.601296:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.601303:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764811.601340:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039552:0@lo:501: 00000100:00100000:2.0:1787764811.601362:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.601404:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcaf7da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764811.601449:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222039552 00000100:00100000:0.0:1787764811.601452:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222039552 00000100:00100000:0.0:1787764811.601474:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787764811.601479:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222039552:12345-0@lo:501: 00000100:00100000:0.0:1787764811.601640:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222039552:12345-0@lo:501: Request processed in 160us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764811.601647:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787764811.601664:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039552:0@lo:501: 00000100:00100000:2.0:1787764811.601688:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039680:0@lo:503: 00000100:00100000:2.0:1787764811.601712:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.601731:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcaf7da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764811.601747:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222039680 00000100:00100000:1.0:1787764811.601750:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222039680 00000100:00100000:1.0:1787764811.601778:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787764811.601783:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222039680:12345-0@lo:503: 00000100:00100000:1.0:1787764811.602103:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222039680:12345-0@lo:503: Request processed in 319us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764811.602110:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787764811.602132:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222039680:0@lo:503: 00000100:00100000:1.0:1787764811.602334:0:6842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6842:1874607222039808:0@lo:502: 00000100:00100000:1.0:1787764811.602359:0:6842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764811.602378:0:6842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb92b4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787764811.602400:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222039808 00000100:00100000:0.0:1787764811.602404:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222039808 00000100:00100000:0.0:1787764811.602446:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787764811.602452:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:6842:x1874607222039808:12345-0@lo:502: 00000100:00100000:0.0:1787764811.602579:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:6842:x1874607222039808:12345-0@lo:502: Request processed in 126us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764811.602605:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787764811.603192:0:6842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6842:1874607222039808:0@lo:502: 00000020:01000000:1.0:1787764811.603207:0:6842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787764811.603215:0:6842:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787764811.603220:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764811.603221:0:6842:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787764811.603225:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787764811.603228:0:6842:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.145@tcp to nid 0x20000c0a8ca91 (192.168.202.145@tcp) 00000020:01000000:1.0:1787764811.603242:0:6842:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787764811.603244:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787764811.603254:0:6842:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90dcb371ced8) 00000020:00000080:1.0:1787764811.603266:0:6842:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787764811.603268:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787764811.603315:0:6842:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787764811.603318:0:6842:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787764811.603322:0:6842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ec49d1dfa4e2233 00010000:00080000:1.0:1787764811.603351:0:6842:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90dc882e7800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.145@tcp at head 00010000:00010000:1.0:1787764811.603540:0:6842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787764811.619317:0:6842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787764811.619337:0:6842:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787764811.619920:0:6842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787764811.620097:0:6842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787764811.620147:0:6842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787764811.620203:0:6842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787764811.621502:0:6843:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787764811.621508:0:6843:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787764811.622350:0:6842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787764811.622361:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787764811.622390:0:6842:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787764811.622407:0:6842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ec49d1dfa4e223a 00000100:00080000:1.0:1787764811.622433:0:6842:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787764811.622439:0:6842:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90dc882e7800 using connection 192.168.202.145@tcp/0@lo 00000100:00100000:1.0:1787764811.622470:0:6842:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90dc99438b40 x1874607222039936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787764811.622511:0:6842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787764811.622755:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222040064:0@lo:400: 00000100:00100000:2.0:1787764811.622839:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.622887:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764811.622893:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222040192:0@lo:400: 00000100:00100000:2.0:1787764811.622927:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.622966:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222040064 00000100:00100000:2.0:1787764811.622972:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222040064 00000100:00100000:2.0:1787764811.623006:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222040192 00000100:00100000:2.0:1787764811.623009:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222040192 00000100:00100000:2.0:1787764811.623037:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787764811.623046:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222040064:12345-0@lo:400: 00000100:00100000:2.0:1787764811.623094:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222040064:12345-0@lo:400: Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.623101:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787764811.623113:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764811.623119:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222040192:12345-0@lo:400: 00000100:00100000:2.0:1787764811.623145:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222040192:12345-0@lo:400: Request processed in 26us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.623151:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787764811.623167:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787764811.623190:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc83c743c0 x1874607222040192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764811.623203:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222040192:0@lo:400: 00010000:00080000:2.0:1787764811.623213:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc83c76580 x1874607222040064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764811.623221:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222040064:0@lo:400: 00000100:00100000:3.0:1787764811.623491:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607222039936:0@lo:8: 00000100:00100000:3.0:1787764811.623530:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787764811.623808:0:6842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764811.623813:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764811.623816:0:6842:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787764811.623819:0:6842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764811.623823:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764811.623825:0:6842:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787764811.623827:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787764811.623829:0:6842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787764811.623851:0:6842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6842:1874607222040320:0@lo:502: 00000100:00100000:1.0:1787764811.623894:0:6842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764811.623922:0:6842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb92b4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787764811.623936:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222040320 00000100:00100000:3.0:1787764811.623941:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222040320 00000100:00100000:3.0:1787764811.623976:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787764811.623985:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:6842:x1874607222040320:12345-0@lo:502: 00000100:00100000:3.0:1787764811.624182:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:6842:x1874607222040320:12345-0@lo:502: Request processed in 198us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764811.624191:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787764811.624207:0:6842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6842:1874607222040320:0@lo:502: 00000020:01000000:1.0:1787764811.624228:0:6842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764811.624231:0:6842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764811.624232:0:6842:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787764811.624234:0:6842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787764811.624307:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787764811.624329:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787764811.624338:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764811.624355:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764811.624364:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222039936 10000000:01000000:3.0:1787764811.624364:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787764811.624369:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dc85d67000 from 1 00000100:00100000:2.0:1787764811.624371:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222039936 10000000:01000000:3.0:1787764811.624373:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787764811.624399:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764811.624403:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764811.624412:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1874607222039936:12345-0@lo:8: 00010000:00010000:3.0:1787764811.624423:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764811.624425:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787764811.624438:0:6649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00010000:3.0:1787764811.624440:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787764811.624460:0:6648:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 121 last 0 00000100:00100000:3.0:1787764811.624464:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222040448:0@lo:101: 00000020:00000080:2.0:1787764811.624487:0:6648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ec49d1dfa4e2248 00000100:00100000:3.0:1787764811.624505:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1787764811.624521:0:6648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90dcbcee3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113976 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1787764811.624526:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4e40 going to sleep for 11 seconds 00002000:00080000:2.0:1787764811.624528:0:6648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:1.0:1787764811.624534:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222040448 00000001:00000004:2.0:1787764811.624534:0:6648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787764811.624541:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222040448 00000100:00100000:1.0:1787764811.624572:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787764811.624580:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222040448:12345-0@lo:101: 00002000:00100000:2.0:1787764811.624663:0:6648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:1.0:1787764811.624721:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764811.624736:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2241 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.624759:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.624784:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764811.624793:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81677200, rc 0) 00002000:00080000:2.0:1787764811.624798:0:6648:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787764811.624824:0:6648:0:(import.c:65:import_set_state_nolock()) ffff90dcbcee6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787764811.624843:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222040448:12345-0@lo:101: Request processed in 263us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764811.624851:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787764811.624871:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1874607222039936:12345-0@lo:8: Request processed in 458us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.624880:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787764811.624919:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc99438b40 x1874607222039936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787764821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764811.624923:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222040448:0@lo:101: 00000100:00100000:2.0:1787764811.624933:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787764811.624939:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787764811.624947:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787764811.624952:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00010000:00010000:0.0:1787764811.624953:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787764811.624955:0:3285:0:(import.c:65:import_set_state_nolock()) ffff90dc882e7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1787764811.624968:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787764811.624971:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787764811.624979:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607222039936:0@lo:8: 00000100:00100000:0.0:1787764811.625037:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb78392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222040576:0@lo:501: 00000100:00100000:0.0:1787764811.625072:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787764811.625099:0:6843:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787764811.625103:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a511c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.625246:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222040576 00000100:00100000:2.0:1787764811.625252:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222040576 00000100:00100000:2.0:1787764811.625283:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787764811.625292:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222040576:12345-0@lo:501: 00000004:00080000:1.0:1787764811.625357:0:6843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 121211771726ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787764811.625549:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222040576:12345-0@lo:501: Request processed in 259us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.625565:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787764811.625574:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb78392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222040576:0@lo:501: 00000100:00100000:0.0:1787764811.625638:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb78392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222040704:0@lo:503: 00000100:00100000:0.0:1787764811.625672:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764811.625692:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a511c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.625721:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222040704 00000100:00100000:2.0:1787764811.625726:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222040704 00000100:00100000:2.0:1787764811.625754:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787764811.625763:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222040704:12345-0@lo:503: 00000100:00100000:2.0:1787764811.627279:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222040704:12345-0@lo:503: Request processed in 1515us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.627288:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787764811.627336:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb78392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222040704:0@lo:503: 00000100:00100000:2.0:1787764811.627543:0:6846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6846:1874607222040832:0@lo:502: 00000100:00100000:2.0:1787764811.627579:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.627620:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222040832 00000100:00100000:2.0:1787764811.627624:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222040832 00000100:00100000:2.0:1787764811.627653:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787764811.627661:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:6846:x1874607222040832:12345-0@lo:502: 00000100:00100000:2.0:1787764811.627912:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:6846:x1874607222040832:12345-0@lo:502: Request processed in 249us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.627919:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787764811.628024:0:6846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8867c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.628036:0:6846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6846:1874607222040832:0@lo:502: 00000020:01000000:2.0:1787764811.628060:0:6846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787764811.628069:0:6846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764811.628072:0:6846:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787764811.628080:0:6846:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90dc85d67000 00000020:00000080:2.0:1787764811.628084:0:6846:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787764811.628107:0:6846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6846:1874607222040960:0@lo:502: 00000100:00100000:2.0:1787764811.628177:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764811.628204:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222040960 00000100:00100000:3.0:1787764811.628209:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222040960 00000100:00100000:3.0:1787764811.628240:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787764811.628249:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:6846:x1874607222040960:12345-0@lo:502: 00000100:00100000:2.0:1787764811.628380:0:6846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8867c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787764811.628527:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:6846:x1874607222040960:12345-0@lo:502: Request processed in 278us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764811.628534:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787764811.629096:0:6846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:6846:1874607222040960:0@lo:502: 00000020:01000000:2.0:1787764811.629116:0:6846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764811.629121:0:6846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764811.629123:0:6846:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787764811.629126:0:6846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787764811.629208:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787764811.629233:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787764811.629241:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764811.629259:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764811.629270:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787764811.629273:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90dc97e31a48 from 1 10000000:01000000:3.0:1787764811.629276:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787764811.629302:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764811.629311:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764811.629320:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764811.629334:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222041088:0@lo:101: 00000100:00100000:3.0:1787764811.629372:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764811.629410:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.629760:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222041088 00000100:00100000:2.0:1787764811.629766:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222041088 00000100:00100000:2.0:1787764811.629864:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787764811.629872:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222041088:12345-0@lo:101: 00010000:00010000:2.0:1787764811.629881:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764811.629902:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2256 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.629924:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.629936:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.629945:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cea00, rc 0) 00000100:00100000:2.0:1787764811.629984:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222041088:12345-0@lo:101: Request processed in 112us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.629991:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787764811.630100:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222041088:0@lo:101: 00010000:00010000:2.0:1787764811.630116:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.630136:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764811.630187:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222041216:0@lo:501: 00000100:00100000:2.0:1787764811.630217:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.630249:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8867c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764811.630254:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222041216 00000100:00100000:3.0:1787764811.630259:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222041216 00000100:00100000:3.0:1787764811.630290:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787764811.630299:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222041216:12345-0@lo:501: 00000100:00100000:3.0:1787764811.630513:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222041216:12345-0@lo:501: Request processed in 215us (293us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787764811.630521:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787764811.630661:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222041216:0@lo:501: 10000000:01000000:2.0:1787764811.630682:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787764811.630686:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764811.630692:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787764811.648482:0:6844:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787764811.648517:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222041344:0@lo:13: 00000100:00100000:1.0:1787764811.648519:0:6844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6844:1874607222041472:0@lo:7: 00000100:00100000:0.0:1787764811.648620:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764811.648670:0:6844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764811.648698:0:6844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb92b4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787764811.648713:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222041344 00000100:00100000:0.0:1787764811.648721:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222041344 00000100:00100000:2.0:1787764811.648758:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222041472 00000100:00100000:2.0:1787764811.648764:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222041472 00000100:00100000:0.0:1787764811.648795:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764811.648808:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787764811.648810:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1874607222041344:12345-0@lo:13: 00000100:00100000:2.0:1787764811.648822:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc9943b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6844:x1874607222041472:12345-0@lo:7: 00002000:00000024:0.0:1787764811.648845:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787764811.648923:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1874607222041344:12345-0@lo:13: Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764811.648932:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787764811.648957:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787764811.648994:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc9943a940 x1874607222041344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764811.649018:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222041344:0@lo:13: 00002000:00080000:2.0:1787764811.654687:0:6650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787764811.654696:0:6650:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787764811.654790:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc9943b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6844:x1874607222041472:12345-0@lo:7: Request processed in 5969us (6118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.654801:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787764811.654849:0:6844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc9943ad00 x1874607222041472/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787764827 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764811.654865:0:6844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6844:1874607222041472:0@lo:7: 00000004:00080000:1.0:1787764811.654880:0:6844:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787764811.654918:0:6844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6844:1874607222041600:0@lo:5: 00000100:00100000:1.0:1787764811.654952:0:6844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764811.655001:0:6844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb92b4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787764811.655020:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222041600 00000100:00100000:0.0:1787764811.655028:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222041600 00000100:00100000:0.0:1787764811.655073:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787764811.655082:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc99438780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6844:x1874607222041600:12345-0@lo:5: 00002000:00080000:0.0:1787764811.655118:0:6649:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787764811.655122:0:6649:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787764811.655339:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc99438780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6844:x1874607222041600:12345-0@lo:5: Request processed in 257us (385us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787764811.655347:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787764811.655375:0:6844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc9943ad00 x1874607222041600/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764827 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764811.655386:0:6844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6844:1874607222041600:0@lo:5: 00000004:00080000:1.0:1787764811.655395:0:6844:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787764811.655447:0:6844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6844:1874607222041728:0@lo:700: 00000100:00100000:1.0:1787764811.655471:0:6844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764811.655492:0:6844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb92b4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.655519:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222041728 00000100:00100000:2.0:1787764811.655524:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222041728 00000100:00100000:2.0:1787764811.655553:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764811.655559:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc99439680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6844:x1874607222041728:12345-0@lo:700: 00000100:00100000:2.0:1787764811.655626:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6657:1874607222041856:0@lo:700: 00000100:00100000:2.0:1787764811.655657:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764811.655679:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8867c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787764811.655700:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222041856 00000100:00100000:2.0:1787764811.655703:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222041856 00000100:00100000:2.0:1787764811.655735:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764811.655743:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6657:x1874607222041856:12345-0@lo:700: 00000004:00080000:1.0:1787764811.665549:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787764811.685370:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787764811.690136:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6657:x1874607222041856:12345-0@lo:700: Request processed in 34386us (34470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764811.690150:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787764811.690381:0:6657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc83c76580 x1874607222041856/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787764827 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764811.690397:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6657:1874607222041856:0@lo:700: 40000000:02000000:1.0:1787764811.690411:0:6657:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1787764811.750202:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc99439680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6844:x1874607222041728:12345-0@lo:700: Request processed in 94633us (94720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764811.750222:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787764811.750303:0:6844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc9943a1c0 x1874607222041728/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787764827 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764811.750319:0:6844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6844:1874607222041728:0@lo:700: 00000001:00080000:3.0:1787764811.750647:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787764811.750661:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1787764811.794685:0:6844:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787764811.803245:0:6844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6844:1874607222041984:0@lo:5: 00000100:00100000:1.0:1787764811.803313:0:6844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764811.803465:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222041984 00000100:00100000:1.0:1787764811.803467:0:6844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b39ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787764811.803481:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222041984 00000100:00100000:3.0:1787764811.803529:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787764811.803537:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc994383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6844:x1874607222041984:12345-0@lo:5: 00002000:00080000:1.0:1787764811.808556:0:6648:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787764811.808576:0:6648:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787764811.811527:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc994383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6844:x1874607222041984:12345-0@lo:5: Request processed in 7984us (8208us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787764811.811540:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787764811.811690:0:6844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc99438f00 x1874607222041984/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764827 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764811.811704:0:6844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787764811.811719:0:6844:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90dc99438f00 x1874607222041984/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764827 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764811.811730:0:6844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6844:1874607222041984:0@lo:5: 00000004:00080000:3.0:1787764811.811743:0:6844:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787764812.046459:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787764812.765251:0:7022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787764813.073459:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764814.093730:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764815.117799:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764816.141794:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764816.845968:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222042496:0@lo:400: 00000100:00100000:0.0:1787764816.846054:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764816.846152:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764816.846160:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222042112:0@lo:400: 00000100:00100000:0.0:1787764816.846188:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764816.846329:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb78383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222042240:0@lo:400: 00000100:00100000:2.0:1787764816.846356:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764816.846395:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764816.846402:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222042368:0@lo:400: 00000100:00100000:2.0:1787764816.846422:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764816.846574:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222042112 00000100:00100000:2.0:1787764816.846597:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222042112 00000100:00100000:2.0:1787764816.846695:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787764816.846705:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:3288:x1874607222042112:12345-0@lo:400: 00000100:00100000:2.0:1787764816.846750:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:3288:x1874607222042112:12345-0@lo:400: Request processed in 47us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764816.846758:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787764816.846805:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222042496 00000100:00100000:2.0:1787764816.846806:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222042112:0@lo:400: 00000100:00100000:1.0:1787764816.846811:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222042496 00000100:00100000:1.0:1787764816.846858:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787764816.846863:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7838b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1874607222042496:12345-0@lo:400: 00000100:00100000:1.0:1787764816.846895:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7838b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1874607222042496:12345-0@lo:400: Request processed in 32us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764816.846909:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787764816.846952:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787764816.847008:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dcb783b840 x1874607222042496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764816.847026:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222042496:0@lo:400: 00000100:00100000:3.0:1787764816.847279:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222042240 00000100:00100000:3.0:1787764816.847284:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222042240 00000100:00100000:3.0:1787764816.847320:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222042368 00000100:00100000:3.0:1787764816.847323:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222042368 00000100:00100000:3.0:1787764816.847360:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764816.847379:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222042240:12345-0@lo:400: 00000100:00100000:3.0:1787764816.847439:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222042240:12345-0@lo:400: Request processed in 71us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764816.847448:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764816.847471:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787764816.847482:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222042368:12345-0@lo:400: 00000100:00100000:3.0:1787764816.847521:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222042368:12345-0@lo:400: Request processed in 42us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764816.847538:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787764816.847799:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dcb7838000 x1874607222042368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764816.847812:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222042368:0@lo:400: 00010000:00080000:2.0:1787764816.847830:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dcb78383c0 x1874607222042240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764816.847840:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb78383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222042240:0@lo:400: 00000100:00100000:0.0:1787764816.848704:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222042624:0@lo:13: 00000100:00080000:1.0:1787764816.848736:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764816.848744:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764816.848773:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222042624 00000100:00100000:1.0:1787764816.848778:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222042624 00000100:00100000:1.0:1787764816.848808:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787764816.848814:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7839a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607222042624:12345-0@lo:13: 00002000:00000024:1.0:1787764816.848836:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764816.848882:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7839a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607222042624:12345-0@lo:13: Request processed in 68us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764816.848887:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787764816.849010:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc83c770c0 x1874607222042624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764816.849026:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222042624:0@lo:13: 00000001:00080000:3.0:1787764816.875519:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787764817.165649:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764818.190781:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764819.214260:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764820.237661:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787764820.379523:0:7588:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787764820.379526:0:7588:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787764820.379681:0:7588:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90dcbd590000 00000020:01000004:0.0:1787764820.379695:0:7588:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787764820.379707:0:7588:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787764820.379719:0:7588:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90dcb7851a48) 00000020:00000080:0.0:1787764820.379734:0:7588:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787764820.389195:0:7588:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787764820.389378:0:7588:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787764820.400741:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787764820.403397:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787764820.403417:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787764820.403448:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787764820.403463:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787764820.403797:0:7588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787764820.403808:0:7588:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787764820.403814:0:7588:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3ec49d1dfa4e226b 00000020:01000004:0.0:1787764820.403820:0:7588:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787764820.403838:0:7588:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.145@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787764820.403841:0:7588:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787764820.403846:0:7588:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787764820.403867:0:7588:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787764820.403871:0:7588:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787764820.413249:0:7588:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.145@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787764820.413277:0:7588:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.145@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787764820.413280:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787764820.413281:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787764820.413282:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764820.413283:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764820.413283:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764820.413284:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764820.413285:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764820.413287:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764820.413287:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764820.413288:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764820.413289:0:7588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787764820.413292:0:7588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787764820.413293:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787764820.413294:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787764820.413295:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764820.413295:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787764820.413296:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764820.413297:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764820.413297:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764820.413298:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787764820.413299:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787764820.413302:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764820.413302:0:7588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787764820.413323:0:7588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787764820.413350:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222042752:0@lo:253: 00000100:00100000:1.0:1787764820.413421:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.413487:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222042752 00000100:00100000:3.0:1787764820.413494:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222042752 00000100:00100000:1.0:1787764820.413523:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b5b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787764820.413547:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787764820.413556:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+16:7588:x1874607222042752:12345-0@lo:253: 20000000:01000000:3.0:1787764820.413601:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787764820.413606:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787764820.413611:0:5798:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787764820.413614:0:5798:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787764820.414913:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764820.415073:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787764820.415083:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787764820.415108:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787764820.415113:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787764820.415127:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787764820.415154:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787764820.415422:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787764820.415436:0:5798:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.145@tcp 20000000:01000000:3.0:1787764820.415437:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.145@tcp (null) (null) (null) 00000040:00080000:3.0:1787764820.415457:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787764820.415461:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787764820.415485:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787764820.415489:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.145@tcp (null) (null) 00000040:00080000:3.0:1787764820.415506:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787764820.415511:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787764820.415526:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787764820.415550:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787764820.416147:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787764820.416157:0:5798:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.145@tcp 20000000:01000000:3.0:1787764820.416158:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.145@tcp (null) (null) (null) 00000040:00080000:3.0:1787764820.416176:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787764820.416180:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787764820.416195:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787764820.416198:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.145@tcp (null) (null) 00000040:00080000:3.0:1787764820.416213:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787764820.416217:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787764820.416254:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787764820.416278:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787764820.416288:0:5798:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787764820.416290:0:5798:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787764820.416292:0:5798:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787764820.416301:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787764820.416303:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787764820.416323:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787764820.416324:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787764820.416752:0:7590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787764820.416909:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787764820.416932:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787764820.416974:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787764820.416987:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787764820.416989:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787764820.417509:0:7591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787764820.417537:0:7591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787764820.417566:0:7591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787764820.418015:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787764820.418036:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787764820.418066:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787764820.418073:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787764820.418075:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787764820.418725:0:7592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787764820.418759:0:7592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787764820.418788:0:7592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787764820.418986:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787764820.419041:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787764820.419079:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787764820.419090:0:5798:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787764820.419092:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787764820.420234:0:7593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787764820.420282:0:7593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787764820.420300:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787764820.420537:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787764820.420580:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787764820.420766:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787764820.420783:0:5798:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787764820.420792:0:5798:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787764820.420801:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787764820.420819:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.420845:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e21b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.420852:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.420858:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.420864:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.420871:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.420878:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.420910:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.420922:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.420933:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222042880:0@lo:104: 00000100:00100000:3.0:1787764820.421001:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764820.421044:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1787764820.421055:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764820.421057:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222042880 00000100:00100000:0.0:1787764820.421062:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222042880 00010000:00010000:3.0:1787764820.421068:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.421076:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222043008:0@lo:104: 00000100:00100000:3.0:1787764820.421097:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764820.421105:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222043008 00000100:00100000:0.0:1787764820.421107:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222043008 00010000:00010000:3.0:1787764820.421115:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764820.421121:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787764820.421123:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764820.421128:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc887f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:5798:x1874607222042880:12345-0@lo:104: 00000100:00100000:3.0:1787764820.421130:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222043136:0@lo:104: 00010000:00010000:0.0:1787764820.421139:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.421148:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764820.421163:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.421170:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.421178:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222043264:0@lo:104: 00000100:00100000:3.0:1787764820.421196:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764820.421218:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e21b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.421226:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e21b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.421233:0:5798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222043392:0@lo:104: 00010000:00010000:0.0:1787764820.421242:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787764820.421247:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc887f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:5798:x1874607222042880:12345-0@lo:104: Request processed in 120us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.421254:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787764820.421270:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.421281:0:5798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbce99300 going to sleep for 11 seconds 00000100:00100000:0.0:1787764820.421289:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222043136 00000100:00100000:0.0:1787764820.421292:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222043136 00000100:00100000:3.0:1787764820.421298:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222042880:0@lo:104: 00000100:00100000:0.0:1787764820.421302:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222043264 00000100:00100000:0.0:1787764820.421303:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222043264 00000100:00100000:0.0:1787764820.421310:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222043392 00000100:00100000:0.0:1787764820.421312:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222043392 00000100:00100000:0.0:1787764820.421323:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787764820.421328:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+6:5798:x1874607222043008:12345-0@lo:104: 00010000:00010000:0.0:1787764820.421350:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421404:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787764820.421411:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421419:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130200 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:2.0:1787764820.421422:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421430:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764820.421438:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764820.421454:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787764820.421484:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421492:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787764820.421564:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222043520:0@lo:103: 00010000:00010000:2.0:1787764820.421604:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421612:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc93130200/0x3ec49d1dfa4e2256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e225d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.421614:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787764820.421625:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787764820.421629:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421634:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940cfc00 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:2.0:1787764820.421637:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421644:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764820.421650:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764820.421655:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787764820.421680:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421685:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764820.421696:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421703:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e221e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2225 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.421713:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764820.421715:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764820.421717:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764820.421734:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222043648:0@lo:103: 00000100:00100000:2.0:1787764820.421759:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.421812:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222043008:0@lo:104: 00010000:00010000:0.0:1787764820.421844:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787764820.421850:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+6:5798:x1874607222043008:12345-0@lo:104: Request processed in 522us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.421856:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787764820.421873:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787764820.421882:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+5:5798:x1874607222043136:12345-0@lo:104: 00010000:00010000:0.0:1787764820.421890:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.421933:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787764820.421939:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+5:5798:x1874607222043136:12345-0@lo:104: Request processed in 59us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.421950:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222043136:0@lo:104: 00000100:00100000:0.0:1787764820.421969:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787764820.421986:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787764820.421993:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:5798:x1874607222043264:12345-0@lo:104: 00010000:00010000:0.0:1787764820.422000:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422049:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787764820.422056:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:5798:x1874607222043264:12345-0@lo:104: Request processed in 64us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.422062:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764820.422069:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222043264:0@lo:104: 00000100:00100000:0.0:1787764820.422081:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787764820.422088:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+3:5798:x1874607222043392:12345-0@lo:104: 00010000:00010000:0.0:1787764820.422094:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e21ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422129:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787764820.422129:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222043520 00000100:00100000:1.0:1787764820.422134:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222043520 00000100:00100000:0.0:1787764820.422135:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+3:5798:x1874607222043392:12345-0@lo:104: Request processed in 48us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.422140:0:5798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1874607222043392:0@lo:104: 00000100:00100000:0.0:1787764820.422145:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787764820.422157:0:6665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 17 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422165:0:6664:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787764820.422170:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.422173:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422178:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131600 already unused, calling callback (ffffffffc1c2fc20) 00000100:00100000:1.0:1787764820.422178:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222043648 00000100:00100000:1.0:1787764820.422183:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222043648 10000000:00010000:0.0:1787764820.422184:0:6664:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.422198:0:6665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 18 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422203:0:6664:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764820.422210:0:6664:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764820.422215:0:6664:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787764820.422219:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787764820.422226:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc9943b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+18:3286:x1874607222043520:12345-0@lo:103: 00000100:00100000:3.0:1787764820.422232:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787764820.422235:0:6664:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.422236:0:6665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764820.422242:0:6664:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764820.422242:0:6665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 18 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.422244:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+18:3287:x1874607222043648:12345-0@lo:103: 00010000:00010000:0.0:1787764820.422254:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.422258:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764820.422267:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc93131600/0x3ec49d1dfa4e2202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2209 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.422267:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 18 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.422271:0:6665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 18 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.422293:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 18 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422299:0:6664:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787764820.422313:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940cea00/0x3ec49d1dfa4e225d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2256 expref: 18 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.422319:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc81676600/0x3ec49d1dfa4e2225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e221e expref: 18 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.422391:0:6665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764820.422391:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764820.422395:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787764820.422401:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e21ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.422408:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc88587800 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:2.0:1787764820.422412:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e21ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.422418:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764820.422425:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.422431:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc9943b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+16:3286:x1874607222043520:12345-0@lo:103: Request processed in 206us (815us total) trans 0 rc 0/0 10000000:01000000:2.0:1787764820.422431:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787764820.422438:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787764820.422442:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+16:3287:x1874607222043648:12345-0@lo:103: Request processed in 200us (680us total) trans 0 rc 0/0 00010000:00010000:2.0:1787764820.422448:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e21ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.422455:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787764820.422461:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787764820.422468:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222043520:0@lo:103: 00010000:00010000:2.0:1787764820.422468:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e21ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.422481:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e21ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21b5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.422490:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764820.422492:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764820.422494:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764820.422506:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222043776:0@lo:103: 00000100:00100000:2.0:1787764820.422530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.422551:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787764820.422556:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222043904:0@lo:103: 00000100:00100000:2.0:1787764820.422576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.422768:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222043776 00000100:00100000:2.0:1787764820.422773:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222043648:0@lo:103: 00000100:00100000:3.0:1787764820.422780:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222043776 00010000:00010000:2.0:1787764820.422791:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764820.422801:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 15 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.422813:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222043904 00000100:00100000:1.0:1787764820.422819:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222043904 00010000:00010000:0.0:1787764820.422829:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.422830:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787764820.422836:0:6665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e21b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422840:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc81676800 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:0.0:1787764820.422846:0:6664:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.422846:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c75680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+16:3288:x1874607222043776:12345-0@lo:103: 00000100:00100000:1.0:1787764820.422860:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787764820.422860:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764820.422861:0:6664:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.422869:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764820.422871:0:6664:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.422873:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+16:3288:x1874607222043904:12345-0@lo:103: 00010000:00010000:1.0:1787764820.422886:0:6665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:0.0:1787764820.422887:0:6664:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764820.422890:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.422892:0:6665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e21b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422902:0:6664:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422908:0:6664:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764820.422914:0:6665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e21b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.422915:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e2209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2202 expref: 16 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422919:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.422935:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc81676800/0x3ec49d1dfa4e21d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21df expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.422936:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e21b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ae expref: 15 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.422936:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764820.422953:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764820.422955:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764820.422958:0:6665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787764820.422976:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c75680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+14:3288:x1874607222043776:12345-0@lo:103: Request processed in 134us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764820.422992:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+14:3288:x1874607222043904:12345-0@lo:103: Request processed in 122us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764820.423039:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222043904:0@lo:103: 00000100:00100000:2.0:1787764820.423046:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222043776:0@lo:103: 00000100:00100000:2.0:1787764820.423070:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787764820.423075:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb783b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222044032:0@lo:103: 00000100:00100000:2.0:1787764820.423096:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.423096:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787764820.423105:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764820.423119:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222044032 00000100:00100000:3.0:1787764820.423123:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222044032 00010000:00010000:3.0:1787764820.423137:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 13 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.423145:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764820.423167:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787764820.423175:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+13:3287:x1874607222044032:12345-0@lo:103: 00010000:00010000:3.0:1787764820.423182:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764820.423186:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 13 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423205:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 13 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423215:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e21df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21d8 expref: 13 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423226:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423234:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423245:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423252:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423259:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423265:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423269:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130600 already unused, calling callback (ffffffffc15ff530) 00010000:00010000:3.0:1787764820.423274:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423281:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423312:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.423321:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764820.423347:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.423356:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.423363:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc93130600/0x3ec49d1dfa4e2272 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.423372:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+12:3287:x1874607222044032:12345-0@lo:103: Request processed in 195us (275us total) trans 0 rc 0/0 20000000:01000000:1.0:1787764820.423380:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787764820.423380:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787764820.423447:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb783b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222044032:0@lo:103: 00000100:00100000:2.0:1787764820.454310:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+11:7588:x1874607222042752:12345-0@lo:253: Request processed in 40748us (40880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764820.454325:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787764820.454441:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222042752:0@lo:253: 10000000:01000000:1.0:1787764820.454456:0:7588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787764820.454459:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787764820.454460:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787764820.454461:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787764820.454463:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787764820.454464:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787764820.454466:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787764820.454467:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787764820.454469:0:7588:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787764820.454470:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787764820.454472:0:7588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787764820.454490:0:7588:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90dcbd590000 from lustre-OST0001 10000000:01000000:1.0:1787764820.454507:0:7588:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787764820.454509:0:7588:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787764820.454515:0:7588:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90dc97e31a48 local copy 10000000:01000000:1.0:1787764820.454518:0:7588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787764820.454555:0:7588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.454563:0:7588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.454630:0:7588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.454645:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044160:0@lo:101: 00000100:00100000:1.0:1787764820.454670:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.454744:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b5b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787764820.454878:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222044160 00000100:00100000:2.0:1787764820.454884:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222044160 00000100:00100000:2.0:1787764820.454963:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787764820.454972:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+11:7588:x1874607222044160:12345-0@lo:101: 00010000:00010000:2.0:1787764820.454984:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764820.454996:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940cfc00/0x3ec49d1dfa4e2280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2279 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.455019:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940cfc00/0x3ec49d1dfa4e2280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2279 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.455030:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940cfc00/0x3ec49d1dfa4e2280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2279 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.455039:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cfc00, rc 0) 00000100:00100000:2.0:1787764820.455076:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044160:12345-0@lo:101: Request processed in 105us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764820.455082:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787764820.455132:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044160:0@lo:101: 00010000:00010000:1.0:1787764820.455141:0:7588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.455149:0:7588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.455228:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044288:0@lo:501: 00000100:00100000:1.0:1787764820.455249:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.455296:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b5b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787764820.455353:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222044288 00000100:00100000:0.0:1787764820.455358:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222044288 00000100:00100000:0.0:1787764820.455387:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787764820.455394:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044288:12345-0@lo:501: 00000100:00100000:0.0:1787764820.455559:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044288:12345-0@lo:501: Request processed in 166us (308us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764820.455564:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787764820.455647:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044288:0@lo:501: 10000000:01000000:1.0:1787764820.455655:0:7588:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787764820.455671:0:7588:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787764820.455675:0:7588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.455680:0:7588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.455689:0:7588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.455702:0:7588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787764820.455718:0:7588:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90dcbd590000 10000000:01000000:1.0:1787764820.455722:0:7588:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787764820.455726:0:7588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:2.0:1787764820.455727:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1787764820.455729:0:7588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787764820.455733:0:7588:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 00010000:00010000:2.0:1787764820.455734:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764820.455735:0:7588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787764820.455741:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc81677a00 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:2.0:1787764820.455745:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.455747:0:7588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.455754:0:7588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.455755:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.455762:0:7588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764820.455762:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.455773:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044416:0@lo:101: 00000100:00100000:1.0:1787764820.455796:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.455825:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b5b6a80 going to sleep for 11 seconds 10000000:01000000:2.0:1787764820.455848:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787764820.455871:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.455878:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787764820.455904:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.455912:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e2279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ec49d1dfa4e2280 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.455924:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222044544:0@lo:103: 00010000:00010000:2.0:1787764820.455925:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764820.455927:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764820.455929:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764820.455950:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764820.456023:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222044416 00000100:00100000:0.0:1787764820.456027:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222044416 00000100:00100000:0.0:1787764820.456057:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787764820.456064:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044416:12345-0@lo:101: 00010000:00010000:0.0:1787764820.456070:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764820.456079:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2287 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.456116:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.456126:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.456132:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc88587400, rc 0) 00000100:00100000:0.0:1787764820.456162:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222044416:12345-0@lo:101: Request processed in 99us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.456168:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787764820.456197:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044416:0@lo:101: 00010000:00010000:0.0:1787764820.456207:0:7588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764820.456215:0:7588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764820.456236:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222044544 00000100:00100000:2.0:1787764820.456241:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222044544 00000100:00100000:0.0:1787764820.456265:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044672:0@lo:501: 00000100:00100000:2.0:1787764820.456267:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764820.456272:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc99438000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+13:3287:x1874607222044544:12345-0@lo:103: 00010000:00010000:2.0:1787764820.456280:0:6665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787764820.456286:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787764820.456290:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940cfc00/0x3ec49d1dfa4e2280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2279 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764820.456299:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbe521480 going to sleep for 11 seconds 00010000:00010000:2.0:1787764820.456300:0:6665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764820.456310:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222044672 00000100:00100000:0.0:1787764820.456314:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222044672 00000100:00100000:2.0:1787764820.456325:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc99438000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+13:3287:x1874607222044544:12345-0@lo:103: Request processed in 53us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764820.456331:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787764820.456690:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787764820.456697:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044672:12345-0@lo:501: 00000100:00100000:2.0:1787764820.456704:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222044544:0@lo:103: 00000100:00100000:0.0:1787764820.456836:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044672:12345-0@lo:501: Request processed in 139us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.456843:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787764820.456871:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044672:0@lo:501: 00000100:00100000:2.0:1787764820.456905:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044800:0@lo:503: 00000100:00100000:2.0:1787764820.456939:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.456953:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222044800 00000100:00100000:3.0:1787764820.456957:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222044800 00000100:00100000:2.0:1787764820.456974:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764820.457042:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787764820.457050:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044800:12345-0@lo:503: 00000100:00100000:3.0:1787764820.457184:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044800:12345-0@lo:503: Request processed in 134us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.457191:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787764820.457363:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044800:0@lo:503: 00000040:00080000:2.0:1787764820.457575:0:7588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787764820.457658:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044928:0@lo:502: 00000100:00100000:2.0:1787764820.457684:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.457705:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764820.457721:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222044928 00000100:00100000:1.0:1787764820.457724:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222044928 00000100:00100000:1.0:1787764820.457788:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787764820.457795:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044928:12345-0@lo:502: 00000100:00100000:1.0:1787764820.457924:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222044928:12345-0@lo:502: Request processed in 128us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764820.457931:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787764820.458024:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222044928:0@lo:502: 00000040:00080000:2.0:1787764820.458171:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787764820.458200:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787764820.458217:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787764820.458241:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787764820.458258:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787764820.458274:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787764820.458287:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045056:0@lo:502: 00000100:00100000:2.0:1787764820.458309:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.458492:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222045056 00000100:00100000:3.0:1787764820.458496:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222045056 00000100:00100000:2.0:1787764820.458497:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764820.458549:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787764820.458555:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222045056:12345-0@lo:502: 00000100:00100000:3.0:1787764820.458678:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222045056:12345-0@lo:502: Request processed in 122us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.458685:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787764820.458697:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045056:0@lo:502: 00000040:00080000:2.0:1787764820.458760:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787764820.458908:0:7588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787764820.459222:0:7596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787764820.459228:0:7596:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787764820.459232:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764820.459234:0:7596:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787764820.459238:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787764820.459255:0:7596:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90dcbc6b1a48) 00000020:00000080:1.0:1787764820.459270:0:7596:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787764820.459274:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787764820.459316:0:7596:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90dcbd590000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787764820.459320:0:7596:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787764820.459324:0:7596:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3ec49d1dfa4e229c 00010000:00010000:1.0:1787764820.462444:0:7596:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787764820.462759:0:7596:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787764820.463931:0:7596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787764820.464084:0:7596:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787764820.465736:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787764820.466221:0:7596:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787764820.467611:0:7596:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787764820.467622:0:7596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764820.467627:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764820.467630:0:7596:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787764820.467634:0:7596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764820.467638:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764820.467640:0:7596:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787764820.467644:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787764820.467646:0:7596:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787764820.467683:0:7596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764820.467686:0:7596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764820.467694:0:7596:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787764820.467697:0:7596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787764820.467793:0:7588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787764820.467822:0:7588:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787764820.468075:0:7588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.468088:0:7588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764820.468103:0:7588:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dcbd590000 from 1 10000000:01000000:2.0:1787764820.468107:0:7588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787764820.468138:0:7588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.468146:0:7588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.468157:0:7588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764820.468177:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045184:0@lo:101: 00000100:00100000:2.0:1787764820.468237:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.468274:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222045184 00000100:00100000:1.0:1787764820.468282:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222045184 00000100:00100000:2.0:1787764820.468284:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764820.468522:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787764820.468535:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:7588:x1874607222045184:12345-0@lo:101: 00010000:00010000:1.0:1787764820.468548:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764820.468560:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e22a3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.468659:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.468671:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.468679:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81676400, rc 0) 00000100:00100000:2.0:1787764820.468806:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045184:0@lo:101: 00010000:00010000:2.0:1787764820.468821:0:7588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.468869:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045184:12345-0@lo:101: Request processed in 336us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764820.468877:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1787764820.469045:0:7588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764820.469121:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045312:0@lo:501: 00000100:00100000:2.0:1787764820.469148:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.469171:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787764820.469192:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222045312 00000100:00100000:3.0:1787764820.469198:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222045312 00000100:00100000:3.0:1787764820.469224:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787764820.469232:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045312:12345-0@lo:501: 00000100:00100000:3.0:1787764820.469428:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045312:12345-0@lo:501: Request processed in 196us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.469441:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787764820.469465:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045312:0@lo:501: 00000100:00100000:2.0:1787764820.469500:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045440:0@lo:503: 00000100:00100000:2.0:1787764820.469542:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.469559:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764820.469645:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222045440 00000100:00100000:1.0:1787764820.469649:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222045440 00000100:00100000:1.0:1787764820.469672:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787764820.469679:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045440:12345-0@lo:503: 00000100:00100000:1.0:1787764820.469993:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045440:12345-0@lo:503: Request processed in 314us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764820.470001:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787764820.470028:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045440:0@lo:503: 00000040:00080000:2.0:1787764820.470221:0:7588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787764820.470284:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045568:0@lo:502: 00000100:00100000:2.0:1787764820.470316:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.470348:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787764820.470370:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222045568 00000100:00100000:3.0:1787764820.470375:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222045568 00000100:00100000:3.0:1787764820.470400:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787764820.470407:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045568:12345-0@lo:502: 00000100:00100000:3.0:1787764820.470531:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045568:12345-0@lo:502: Request processed in 124us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.470540:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787764820.470555:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045568:0@lo:502: 00000040:00080000:2.0:1787764820.472144:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787764820.472213:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787764820.472245:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045696:0@lo:502: 00000100:00100000:2.0:1787764820.472292:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.472328:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764820.473855:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222045696 00000100:00100000:0.0:1787764820.473863:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222045696 00000100:00100000:0.0:1787764820.473914:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787764820.473924:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045696:12345-0@lo:502: 00000100:00100000:0.0:1787764820.474236:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045696:12345-0@lo:502: Request processed in 313us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.474243:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787764820.474493:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045696:0@lo:502: 00000040:00080000:1.0:1787764820.474703:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787764820.474721:0:7588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787764820.476252:0:7600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764820.476262:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764820.476265:0:7600:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787764820.476271:0:7600:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90dcbd590000 00000020:00000080:0.0:1787764820.476274:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787764820.476291:0:7600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764820.476294:0:7600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764820.476295:0:7600:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787764820.476298:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787764820.476413:0:7588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787764820.476436:0:7588:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764820.476461:0:7588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.476473:0:7588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764820.476507:0:7588:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787764820.476511:0:7588:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90dcbd590000 10000000:01000000:1.0:1787764820.476514:0:7588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90dcbd590000 10000000:01000000:1.0:1787764820.476517:0:7588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787764820.476522:0:7588:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dcbd590000 from 1 10000000:01000000:1.0:1787764820.476524:0:7588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787764820.476551:0:7588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.476558:0:7588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.476567:0:7588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.476687:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045824:0@lo:101: 00000100:00100000:1.0:1787764820.476733:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.476769:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b5b6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787764820.477026:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222045824 00000100:00100000:2.0:1787764820.477032:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222045824 00000100:00100000:2.0:1787764820.477133:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787764820.477140:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222045824:12345-0@lo:101: 00010000:00010000:2.0:1787764820.477149:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764820.477158:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e22b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.477174:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.477181:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.477186:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940ce800, rc 0) 00000100:00100000:2.0:1787764820.477232:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222045824:12345-0@lo:101: Request processed in 92us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764820.477238:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787764820.477293:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045824:0@lo:101: 00010000:00010000:1.0:1787764820.477305:0:7588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764820.477323:0:7588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764820.477398:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045952:0@lo:501: 00000100:00100000:1.0:1787764820.477421:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.477655:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b5b6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764820.477735:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222045952 00000100:00100000:0.0:1787764820.477739:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222045952 00000100:00100000:0.0:1787764820.477756:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787764820.477762:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222045952:12345-0@lo:501: 00000100:00100000:0.0:1787764820.477938:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222045952:12345-0@lo:501: Request processed in 175us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.477945:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787764820.478389:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222045952:0@lo:501: 00000100:00100000:1.0:1787764820.478407:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222046080:0@lo:503: 00000100:00100000:1.0:1787764820.478433:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.478448:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b5b6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764820.478464:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222046080 00000100:00100000:0.0:1787764820.478469:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222046080 00000100:00100000:0.0:1787764820.478499:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787764820.478506:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222046080:12345-0@lo:503: 00000100:00100000:0.0:1787764820.478632:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222046080:12345-0@lo:503: Request processed in 127us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.478647:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787764820.478647:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222046080:0@lo:503: 00000040:00080000:1.0:1787764820.478843:0:7588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787764820.478889:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222046208:0@lo:502: 00000100:00100000:1.0:1787764820.478911:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.478934:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b5b6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764820.478947:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222046208 00000100:00100000:1.0:1787764820.478949:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222046208 00000100:00100000:1.0:1787764820.478971:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787764820.478977:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222046208:12345-0@lo:502: 00000100:00100000:1.0:1787764820.479128:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222046208:12345-0@lo:502: Request processed in 151us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764820.479135:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787764820.479149:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222046208:0@lo:502: 00000040:00080000:2.0:1787764820.479387:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787764820.479432:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787764820.479465:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787764820.479504:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787764820.479524:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787764820.479547:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787764820.479565:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787764820.479624:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787764820.479683:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787764820.479709:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787764820.479726:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787764820.479750:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787764820.479767:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787764820.479783:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787764820.479825:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787764820.479845:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787764820.479861:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787764820.479905:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787764820.479937:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787764820.479984:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787764820.480030:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787764820.480072:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787764820.480092:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787764820.480126:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787764820.480147:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787764820.480163:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787764820.480187:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787764820.480213:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787764820.480229:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787764820.480280:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787764820.480326:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787764820.480375:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787764820.480397:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787764820.480423:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787764820.480442:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787764820.480465:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787764820.480482:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787764820.480498:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222046336:0@lo:502: 00000100:00100000:2.0:1787764820.480528:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.480555:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787764820.480564:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222046336 00000100:00100000:3.0:1787764820.480578:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222046336 00000100:00100000:3.0:1787764820.481438:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787764820.481446:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222046336:12345-0@lo:502: 00000100:00100000:3.0:1787764820.481746:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222046336:12345-0@lo:502: Request processed in 300us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.481755:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787764820.481826:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222046336:0@lo:502: 00000040:00080000:2.0:1787764820.481889:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787764820.481899:0:7588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787764820.482403:0:7601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787764820.482413:0:7601:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90dcb7afb490) 00000020:00000080:3.0:1787764820.482428:0:7601:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787764820.482485:0:7601:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90dcbd590000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787764820.482488:0:7601:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90dcbd590000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787764820.482490:0:7601:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90dcbd590000 3 00010000:00080000:3.0:1787764820.482510:0:7601:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90dcbd712800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.145@tcp at head 00010000:00010000:3.0:1787764820.483988:0:7601:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787764820.484167:0:7601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787764820.484183:0:7601:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787764820.484189:0:7601:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3ec49d1dfa4e22c6 00000100:00080000:3.0:1787764820.484194:0:7601:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787764820.484201:0:7601:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90dcbd712800 using connection 192.168.202.145@tcp/0@lo 00000100:00100000:3.0:1787764820.484223:0:7601:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90dcb7bd1e00 x1874607222046464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787764820.484244:0:7601:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787764820.484318:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764820.484329:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222046848:0@lo:400: 00000100:00100000:3.0:1787764820.484379:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764820.484631:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1874607222046464:0@lo:38: 00000100:00100000:0.0:1787764820.484664:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764820.484744:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222046464 00000100:00100000:1.0:1787764820.484749:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222046464 00000100:00100000:1.0:1787764820.484786:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787764820.484799:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1874607222046464:12345-0@lo:38: 00010000:00080000:1.0:1787764820.484818:0:5804:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:1.0:1787764820.484844:0:5804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3ec49d1dfa4e22cd 00000004:00100000:1.0:1787764820.484856:0:5804:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787764820.484891:0:5804:0:(import.c:65:import_set_state_nolock()) ffff90dc8307d000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1787764820.484891:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787764820.484943:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874607222046464:12345-0@lo:38: Request processed in 144us (277us total) trans 0 rc 0/0 00000100:00080000:3.0:1787764820.485004:0:7602:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff90dcb7bd30c0 x1874607222046976/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764820.485014:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbce99b40 going to sleep for 0 seconds 00000100:00100000:3.0:1787764820.485642:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607222046720:0@lo:400: 00000100:00100000:3.0:1787764820.485667:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.485683:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787764820.485688:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222046592:0@lo:400: 00000100:00100000:3.0:1787764820.485700:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.485725:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222046720 00000100:00100000:3.0:1787764820.485728:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222046720 00000100:00100000:0.0:1787764820.486131:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222046592 00000100:00100000:0.0:1787764820.486136:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222046592 00000100:00100000:1.0:1787764820.486137:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787764820.486155:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787764820.486162:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222046592:12345-0@lo:400: 00000100:00100000:3.0:1787764820.486220:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787764820.486229:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607222046720:12345-0@lo:400: 00000100:00100000:0.0:1787764820.486317:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222046592:12345-0@lo:400: Request processed in 156us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764820.486323:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787764820.486362:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dcb7bd1e00 x1874607222046464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787764830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764820.486371:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787764820.486436:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787764820.486501:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787764820.486505:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787764820.486508:0:3285:0:(import.c:65:import_set_state_nolock()) ffff90dcbd712800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787764820.486513:0:3285:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000bafad495): req@ffff90dcb7bd30c0 x1874607222046976/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764820.486527:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1874607222046464:0@lo:38: 00000100:00100000:2.0:1787764820.487164:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222046848 00000100:00100000:2.0:1787764820.487169:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222046848 00000100:00100000:2.0:1787764820.487203:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764820.487210:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222046848:12345-0@lo:400: 00000100:00100000:2.0:1787764820.487251:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222046848:12345-0@lo:400: Request processed in 42us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764820.487258:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787764820.487353:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc9943ad00 x1874607222046848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764820.487361:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787764820.487371:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222046848:0@lo:400: 00000020:01000000:2.0:1787764820.487401:0:7588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787764820.487431:0:7588:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764820.487443:0:7588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.487452:0:7588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787764820.487496:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787764820.487498:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787764820.487499:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764820.487500:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764820.487501:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764820.487503:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764820.487504:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787764820.487506:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764820.487507:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764820.487509:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764820.487510:0:7588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787764820.487513:0:7588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787764820.487515:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787764820.487517:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787764820.487518:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764820.487519:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764820.487520:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764820.487521:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764820.487522:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787764820.487523:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764820.487524:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764820.487525:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764820.487526:0:7588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787764820.487541:0:7588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787764820.487550:0:7588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222047104:0@lo:253: 00000100:00100000:2.0:1787764820.487599:0:7588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.487623:0:7588:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8867cf00 going to sleep for 11 seconds 00010000:00080000:1.0:1787764820.489660:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc9943a940 x1874607222046592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764820.489674:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222046592:0@lo:400: 00000100:00080000:2.0:1787764820.490477:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787764820.490484:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764820.490604:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.490658:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222046976 00000100:00100000:2.0:1787764820.490664:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222046976 00000100:00100000:2.0:1787764820.490719:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787764820.490737:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7602:x1874607222046976:12345-0@lo:901: 00000100:00100000:2.0:1787764820.491094:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7602:x1874607222046976:12345-0@lo:901: Request processed in 361us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764820.491102:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787764820.491119:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787764820.491379:0:7602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dcb7bd30c0 x1874607222046976/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787764836 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764820.491392:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd30c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7602:1874607222046976:0@lo:901: 00000100:00100000:3.0:1787764820.491460:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607222046720:12345-0@lo:400: Request processed in 5229us (5788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.491470:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787764820.491495:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222047104 00000100:00100000:3.0:1787764820.491508:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222047104 00000100:00100000:3.0:1787764820.491536:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787764820.491542:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+14:7588:x1874607222047104:12345-0@lo:253: 20000000:01000000:3.0:1787764820.491568:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787764820.491580:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787764820.492007:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90dc9943a1c0 x1874607222046720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764820.492019:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607222046720:0@lo:400: 20000000:01000000:3.0:1787764820.507423:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787764820.507443:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787764820.507514:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787764820.507519:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787764820.507539:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.507556:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.507564:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.507622:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764820.507635:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 14 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764820.507649:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c76940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874607222047232:0@lo:104: 00000100:00100000:2.0:1787764820.507719:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764820.507757:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbe521480 going to sleep for 11 seconds 00000100:00100000:3.0:1787764820.507890:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222047232 00000100:00100000:3.0:1787764820.507897:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222047232 00000100:00100000:3.0:1787764820.507937:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787764820.507946:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e288f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:5819:x1874607222047232:12345-0@lo:104: 00010000:00010000:3.0:1787764820.508013:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508065:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787764820.508071:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e288f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:5819:x1874607222047232:12345-0@lo:104: Request processed in 127us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.508077:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787764820.508097:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787764820.508103:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508110:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940cee00 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:3.0:1787764820.508114:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508122:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787764820.508129:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764820.508133:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787764820.508163:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508168:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787764820.508182:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508189:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc940cee00/0x3ec49d1dfa4e2210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2217 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508201:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764820.508203:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764820.508204:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764820.508218:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222047360:0@lo:103: 00000100:00100000:3.0:1787764820.508245:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764820.508280:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222047360 00000100:00100000:3.0:1787764820.508284:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222047360 00010000:00010000:3.0:1787764820.508297:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 15 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.508315:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787764820.508321:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+15:3287:x1874607222047360:12345-0@lo:103: 00010000:00010000:3.0:1787764820.508329:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764820.508347:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 15 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508357:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 15 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508371:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508384:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787764820.508395:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001340531s 00010000:00010000:3.0:1787764820.508399:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508405:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508412:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508418:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508423:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940ce600 already unused, calling callback (ffffffffc15ff530) 00010000:00010000:3.0:1787764820.508426:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508434:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508442:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508450:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787764820.508475:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+15:3287:x1874607222047360:12345-0@lo:103: Request processed in 154us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.508482:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787764820.508540:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222047360:0@lo:103: 00010000:00010000:3.0:1787764820.508561:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e2217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2210 expref: 14 pid: 5796 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.508570:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c76940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874607222047232:0@lo:104: 00010000:00010000:3.0:1787764820.508580:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508608:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508615:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764820.508621:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764820.516553:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+13:7588:x1874607222047104:12345-0@lo:253: Request processed in 25002us (28961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764820.516567:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787764820.516686:0:7588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c761c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3db9464f-230d-4339-9306-352e25163ce7:7588:1874607222047104:0@lo:253: 10000000:01000000:2.0:1787764820.516700:0:7588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787764820.516703:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787764820.516704:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787764820.516706:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787764820.516707:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787764820.516708:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787764820.516710:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787764820.516711:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787764820.516713:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787764820.516714:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787764820.516716:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787764820.516717:0:7588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787764820.516730:0:7588:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787764820.520226:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764820.520406:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787764820.520614:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764820.520783:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787764820.521059:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787764820.521204:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787764820.522120:0:7588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787764820.617027:0:7588:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787764820.617034:0:7588:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787764820.617062:0:7588:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787764820.617110:0:7588:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787764820.617126:0:7588:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787764820.617152:0:7588:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787764821.263575:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764821.965841:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e289680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222047488:0@lo:13: 00000100:00100000:0.0:1787764821.965915:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764821.966171:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222047488 00000100:00100000:1.0:1787764821.966178:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222047488 00000100:00100000:1.0:1787764821.966223:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787764821.966230:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222047488:12345-0@lo:13: 00002000:00000024:1.0:1787764821.966259:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764821.966296:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222047488:12345-0@lo:13: Request processed in 67us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764821.966301:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787764821.966351:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e289680 x1874607222047488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764821.966392:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e289680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222047488:0@lo:13: 00010000:00010000:2.0:1787764822.285846:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764823.309745:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764824.337953:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787764824.698752:0:7943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787764825.357789:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764825.553141:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222047616:0@lo:400: 00000100:00100000:3.0:1787764825.553208:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764825.553268:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222048128:0@lo:400: 00000100:00100000:3.0:1787764825.553358:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764825.553381:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787764825.553387:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222048000:0@lo:400: 00000100:00100000:3.0:1787764825.553531:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764825.553559:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222047744:0@lo:400: 00000100:00100000:3.0:1787764825.553581:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764825.553620:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764825.553626:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222047872:0@lo:400: 00000100:00100000:3.0:1787764825.553647:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764825.553681:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222048128 00000100:00100000:3.0:1787764825.553688:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222048128 00000100:00100000:3.0:1787764825.553735:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222047744 00000100:00100000:3.0:1787764825.553738:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222047744 00000100:00100000:3.0:1787764825.553751:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222047872 00000100:00100000:3.0:1787764825.553753:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222047872 00000100:00100000:3.0:1787764825.553768:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787764825.553777:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222048128:12345-0@lo:400: 00000100:00100000:3.0:1787764825.553824:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222048128:12345-0@lo:400: Request processed in 48us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764825.553831:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787764825.553846:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764825.553851:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222047744:12345-0@lo:400: 00000100:00100000:3.0:1787764825.553893:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222047744:12345-0@lo:400: Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764825.553899:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787764825.553910:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787764825.553916:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222047872:12345-0@lo:400: 00000100:00100000:3.0:1787764825.553942:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222047872:12345-0@lo:400: Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764825.553948:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787764825.553972:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222048000 00000100:00100000:3.0:1787764825.553976:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222048000 00000100:00100000:3.0:1787764825.554003:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787764825.554009:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222048000:12345-0@lo:400: 00000100:00100000:1.0:1787764825.554110:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222047616 00000100:00100000:1.0:1787764825.554114:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222047616 00000100:00100000:1.0:1787764825.554139:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787764825.554145:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:3289:x1874607222047616:12345-0@lo:400: 00000100:00100000:3.0:1787764825.554167:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222048000:12345-0@lo:400: Request processed in 158us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764825.554173:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787764825.554177:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:3289:x1874607222047616:12345-0@lo:400: Request processed in 33us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764825.554181:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787764825.554193:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764825.554198:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787764825.554223:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc99438000 x1874607222048000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764825.554237:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222048000:0@lo:400: 00010000:00080000:3.0:1787764825.554248:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc9943ad00 x1874607222048128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764825.554255:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222048128:0@lo:400: 00000100:00100000:3.0:1787764825.554264:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222047616:0@lo:400: 00010000:00080000:3.0:1787764825.554310:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc9943b840 x1874607222047872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764825.554320:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222047872:0@lo:400: 00010000:00080000:3.0:1787764825.554329:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc9943a1c0 x1874607222047744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764825.554336:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222047744:0@lo:400: 00010000:00010000:0.0:1787764826.382349:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764827.086530:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e2892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222048256:0@lo:13: 00000100:00100000:3.0:1787764827.086624:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764827.088817:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222048256 00000100:00100000:2.0:1787764827.088829:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222048256 00000100:00100000:2.0:1787764827.088912:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787764827.088936:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222048256:12345-0@lo:13: 00002000:00000024:2.0:1787764827.088975:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764827.089063:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222048256:12345-0@lo:13: Request processed in 129us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764827.089070:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787764827.089302:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e2892c0 x1874607222048256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764827.089323:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e2892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222048256:0@lo:13: 00000100:00080000:3.0:1787764827.090967:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764827.419364:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764828.429767:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764829.453873:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787764830.158137:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787764830.158146:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dc89161000 from 30 10000000:01000000:3.0:1787764830.158152:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764830.158192:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.158204:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.158216:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764830.158239:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222048384:0@lo:101: 00000100:00100000:3.0:1787764830.158534:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.158687:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fda80 going to sleep for 11 seconds 00000100:00100000:2.0:1787764830.161858:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222048384 00000100:00100000:2.0:1787764830.161868:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222048384 00000100:00100000:2.0:1787764830.161928:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787764830.161938:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222048384:12345-0@lo:101: 00010000:00010000:2.0:1787764830.161954:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764830.161970:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e22db expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.161997:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.162009:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.162018:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940ce600, rc 0) 00000100:00100000:2.0:1787764830.162132:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222048384:12345-0@lo:101: Request processed in 194us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.162139:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787764830.164717:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222048384:0@lo:101: 00010000:00010000:3.0:1787764830.164740:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.164751:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764830.165093:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222048512:0@lo:501: 00000100:00100000:3.0:1787764830.165137:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.165178:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787764830.165295:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222048512 00000100:00100000:1.0:1787764830.165301:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222048512 00000100:00100000:1.0:1787764830.165397:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787764830.165405:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222048512:12345-0@lo:501: 00000100:00100000:1.0:1787764830.165754:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222048512:12345-0@lo:501: Request processed in 347us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.165761:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787764830.165879:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222048512:0@lo:501: 00000100:00100000:3.0:1787764830.165983:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222048640:0@lo:503: 00000100:00100000:3.0:1787764830.166020:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.166103:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fda80 going to sleep for 11 seconds 00000100:00100000:2.0:1787764830.169573:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222048640 00000100:00100000:2.0:1787764830.169599:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222048640 00000100:00100000:2.0:1787764830.169794:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787764830.169804:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222048640:12345-0@lo:503: 00000100:00100000:2.0:1787764830.170196:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222048640:12345-0@lo:503: Request processed in 392us (4173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.170210:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787764830.170257:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222048640:0@lo:503: 00000100:00100000:0.0:1787764830.170673:0:8161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8161:1874607222048768:0@lo:502: 00000100:00100000:0.0:1787764830.170713:0:8161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.178608:0:8161:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a511f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764830.179741:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222048768 00000100:00100000:3.0:1787764830.179759:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222048768 00000100:00100000:3.0:1787764830.180828:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787764830.180840:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:8161:x1874607222048768:12345-0@lo:502: 00000100:00100000:3.0:1787764830.181185:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:8161:x1874607222048768:12345-0@lo:502: Request processed in 346us (10470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.181193:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787764830.181303:0:8161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8161:1874607222048768:0@lo:502: 00000100:00100000:0.0:1787764830.181373:0:8161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8161:1874607222048896:0@lo:502: 00000100:00100000:0.0:1787764830.181415:0:8161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.181445:0:8161:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a511f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764830.181734:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222048896 00000100:00100000:3.0:1787764830.181739:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222048896 00000100:00100000:3.0:1787764830.181757:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787764830.181762:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:8161:x1874607222048896:12345-0@lo:502: 00000100:00100000:3.0:1787764830.182324:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:8161:x1874607222048896:12345-0@lo:502: Request processed in 560us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.182332:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787764830.183018:0:8161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8161:1874607222048896:0@lo:502: 00000040:00080000:0.0:1787764830.183041:0:8161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787764830.183737:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787764830.183757:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764830.183824:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.183836:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764830.183847:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787764830.183849:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787764830.183852:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787764830.183883:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.183892:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.183902:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764830.183916:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049024:0@lo:101: 00000100:00100000:2.0:1787764830.183950:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.183982:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787764830.184296:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222049024 00000100:00100000:3.0:1787764830.184301:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222049024 00000100:00100000:3.0:1787764830.184369:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787764830.184377:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222049024:12345-0@lo:101: 00010000:00010000:3.0:1787764830.184385:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764830.184395:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e22e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.184413:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.184420:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.184435:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc93130800, rc 0) 00000100:00100000:3.0:1787764830.184469:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222049024:12345-0@lo:101: Request processed in 95us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.184473:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787764830.184955:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049024:0@lo:101: 00010000:00010000:2.0:1787764830.185021:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.185032:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764830.185079:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049152:0@lo:501: 00000100:00100000:2.0:1787764830.185103:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.185124:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.185142:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222049152 00000100:00100000:0.0:1787764830.185147:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222049152 00000100:00100000:0.0:1787764830.185180:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787764830.185187:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222049152:12345-0@lo:501: 00000100:00100000:0.0:1787764830.185424:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222049152:12345-0@lo:501: Request processed in 236us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.185431:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787764830.185953:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049152:0@lo:501: 00000100:00100000:2.0:1787764830.186034:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049280:0@lo:503: 00000100:00100000:2.0:1787764830.186065:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.186087:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.186099:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222049280 00000100:00100000:0.0:1787764830.186105:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222049280 00000100:00100000:0.0:1787764830.186171:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787764830.186178:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222049280:12345-0@lo:503: 00000100:00100000:0.0:1787764830.186460:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222049280:12345-0@lo:503: Request processed in 281us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.186467:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787764830.186541:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049280:0@lo:503: 00000100:00100000:2.0:1787764830.187383:0:8162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8162:1874607222049408:0@lo:502: 00000100:00100000:2.0:1787764830.187413:0:8162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.187439:0:8162:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787764830.187801:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222049408 00000100:00100000:3.0:1787764830.187807:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222049408 00000100:00100000:3.0:1787764830.187831:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787764830.187837:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:8162:x1874607222049408:12345-0@lo:502: 00000100:00100000:3.0:1787764830.188010:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:8162:x1874607222049408:12345-0@lo:502: Request processed in 172us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.188018:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787764830.188050:0:8162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8162:1874607222049408:0@lo:502: 00000020:01000000:2.0:1787764830.188072:0:8162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787764830.188081:0:8162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764830.188088:0:8162:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787764830.188093:0:8162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787764830.188094:0:8162:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787764830.188107:0:8162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8162:1874607222049536:0@lo:502: 00000100:00100000:2.0:1787764830.188137:0:8162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.188163:0:8162:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787764830.188366:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222049536 00000100:00100000:3.0:1787764830.188371:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222049536 00000100:00100000:3.0:1787764830.188391:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787764830.188396:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:8162:x1874607222049536:12345-0@lo:502: 00000100:00100000:3.0:1787764830.188682:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:8162:x1874607222049536:12345-0@lo:502: Request processed in 284us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.188689:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787764830.189979:0:8162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8162:1874607222049536:0@lo:502: 00000020:01000000:2.0:1787764830.190003:0:8162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764830.190008:0:8162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764830.190010:0:8162:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787764830.190020:0:8162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787764830.190095:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787764830.190113:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787764830.190120:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.190127:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764830.190142:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787764830.190144:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dc85d67000 from 30 10000000:01000000:3.0:1787764830.190146:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787764830.190164:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.190169:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.190175:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764830.190183:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049664:0@lo:101: 00000100:00100000:3.0:1787764830.190207:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.190233:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764830.191028:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222049664 00000100:00100000:2.0:1787764830.191034:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222049664 00000100:00100000:3.0:1787764830.191104:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787764830.191112:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222049664:12345-0@lo:101: 00010000:00010000:3.0:1787764830.191123:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764830.191135:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e22f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.191155:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.191165:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.191173:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc93131a00, rc 0) 00000100:00100000:3.0:1787764830.191272:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222049664:12345-0@lo:101: Request processed in 160us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.191279:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787764830.191381:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049664:0@lo:101: 00010000:00010000:2.0:1787764830.191394:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.191403:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764830.191441:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049792:0@lo:501: 00000100:00100000:2.0:1787764830.191468:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.191497:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.192302:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222049792 00000100:00100000:0.0:1787764830.192316:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222049792 00000100:00100000:0.0:1787764830.192340:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787764830.192346:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222049792:12345-0@lo:501: 00000100:00100000:0.0:1787764830.192554:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222049792:12345-0@lo:501: Request processed in 208us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.192561:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787764830.192670:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049792:0@lo:501: 00000100:00100000:2.0:1787764830.192691:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049920:0@lo:503: 00000100:00100000:2.0:1787764830.192717:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.192740:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.192839:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222049920 00000100:00100000:0.0:1787764830.192844:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222049920 00000100:00100000:0.0:1787764830.192879:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787764830.192886:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222049920:12345-0@lo:503: 00000100:00100000:0.0:1787764830.193168:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222049920:12345-0@lo:503: Request processed in 282us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.193174:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787764830.193848:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222049920:0@lo:503: 00000100:00100000:3.0:1787764830.194513:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8163:1874607222050048:0@lo:502: 00000100:00100000:3.0:1787764830.194552:0:8163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.194625:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fda80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.194704:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222050048 00000100:00100000:0.0:1787764830.194708:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222050048 00000100:00100000:0.0:1787764830.194740:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787764830.194754:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+16:8163:x1874607222050048:12345-0@lo:502: 00000100:00100000:0.0:1787764830.195064:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+16:8163:x1874607222050048:12345-0@lo:502: Request processed in 311us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.195071:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787764830.195151:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8163:1874607222050048:0@lo:502: 00000100:00100000:3.0:1787764830.195185:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8163:1874607222050176:0@lo:502: 00000100:00100000:3.0:1787764830.195212:0:8163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.195277:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787764830.195359:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222050176 00000100:00100000:1.0:1787764830.195364:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222050176 00000100:00100000:1.0:1787764830.195389:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787764830.195395:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:8163:x1874607222050176:12345-0@lo:502: 00000100:00100000:1.0:1787764830.195554:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:8163:x1874607222050176:12345-0@lo:502: Request processed in 159us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.195561:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787764830.195733:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8163:1874607222050176:0@lo:502: 00000040:00080000:3.0:1787764830.195751:0:8163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787764830.196107:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787764830.196123:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787764830.196130:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.196141:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764830.196149:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787764830.196151:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90dc85d67000 from 5 10000000:01000000:0.0:1787764830.196154:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787764830.196173:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e2305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.196180:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e2305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.196189:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e2305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764830.196200:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050304:0@lo:101: 00000100:00100000:0.0:1787764830.196224:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.196285:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a5116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764830.196361:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222050304 00000100:00100000:3.0:1787764830.196365:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222050304 00000100:00100000:3.0:1787764830.196393:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787764830.196399:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222050304:12345-0@lo:101: 00010000:00010000:3.0:1787764830.196407:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764830.196416:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc93130000/0x3ec49d1dfa4e230c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2305 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.196433:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93130000/0x3ec49d1dfa4e230c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2305 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.196443:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc93130000/0x3ec49d1dfa4e230c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2305 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.196451:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc93130000, rc 0) 00000100:00100000:3.0:1787764830.196520:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222050304:12345-0@lo:101: Request processed in 120us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.196527:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787764830.196572:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050304:0@lo:101: 00010000:00010000:0.0:1787764830.196676:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e2305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e230c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.196693:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e2305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e230c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764830.196729:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050432:0@lo:256: 00000100:00100000:0.0:1787764830.196767:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.196823:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a5116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764830.196852:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222050432 00000100:00100000:1.0:1787764830.196856:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222050432 00000100:00100000:1.0:1787764830.196941:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787764830.196949:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222050432:12345-0@lo:256: 20000000:01000000:1.0:1787764830.196963:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787764830.197035:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787764830.197039:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787764830.197183:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222050432:12345-0@lo:256: Request processed in 234us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.197190:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787764830.197244:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050432:0@lo:256: 10000000:01000000:0.0:1787764830.197291:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787764830.197297:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e2305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e230c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.197304:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc88587800/0x3ec49d1dfa4e2305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e230c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764830.197373:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787764830.197375:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787764830.197378:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787764830.197393:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.197399:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.197407:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764830.197419:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050560:0@lo:101: 00000100:00100000:0.0:1787764830.197452:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.197505:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a5116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764830.197534:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222050560 00000100:00100000:3.0:1787764830.197538:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222050560 00000100:00100000:3.0:1787764830.197565:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787764830.197571:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222050560:12345-0@lo:101: 00010000:00010000:3.0:1787764830.197579:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764830.197690:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2313 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.197705:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.197713:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764830.197720:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc93131e00, rc 0) 00000100:00100000:3.0:1787764830.197788:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222050560:12345-0@lo:101: Request processed in 217us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.197795:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787764830.197844:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050560:0@lo:101: 00010000:00010000:0.0:1787764830.197854:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.197862:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764830.197960:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050688:0@lo:501: 00000100:00100000:0.0:1787764830.198051:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.198116:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a5116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764830.198147:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222050688 00000100:00100000:1.0:1787764830.198151:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222050688 00000100:00100000:1.0:1787764830.198177:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787764830.198184:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222050688:12345-0@lo:501: 00000100:00100000:1.0:1787764830.198529:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222050688:12345-0@lo:501: Request processed in 345us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.198536:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787764830.198661:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050688:0@lo:501: 00000100:00100000:0.0:1787764830.198685:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050816:0@lo:503: 00000100:00100000:0.0:1787764830.198721:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.198778:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a5116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764830.198807:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222050816 00000100:00100000:3.0:1787764830.198812:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222050816 00000100:00100000:3.0:1787764830.198842:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787764830.198849:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222050816:12345-0@lo:503: 00000100:00100000:3.0:1787764830.199280:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222050816:12345-0@lo:503: Request processed in 430us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.199287:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787764830.199401:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222050816:0@lo:503: 00000100:00100000:3.0:1787764830.199856:0:8164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8164:1874607222050944:0@lo:502: 00000100:00100000:3.0:1787764830.199955:0:8164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.200072:0:8164:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764830.200104:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222050944 00000100:00100000:1.0:1787764830.200109:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222050944 00000100:00100000:1.0:1787764830.200141:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787764830.200149:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:8164:x1874607222050944:12345-0@lo:502: 00000100:00100000:1.0:1787764830.200527:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:8164:x1874607222050944:12345-0@lo:502: Request processed in 378us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.200534:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787764830.200677:0:8164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8164:1874607222050944:0@lo:502: 00000020:01000000:3.0:1787764830.200697:0:8164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787764830.200702:0:8164:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787764830.200708:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764830.200710:0:8164:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787764830.200714:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787764830.200718:0:8164:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.145@tcp to nid 0x20000c0a8ca91 (192.168.202.145@tcp) 00000020:01000000:3.0:1787764830.200736:0:8164:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787764830.200738:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787764830.200750:0:8164:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90dcb7af9a48) 00000020:00000080:3.0:1787764830.200767:0:8164:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787764830.200771:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787764830.200827:0:8164:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787764830.200832:0:8164:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787764830.200837:0:8164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ec49d1dfa4e2328 00010000:00080000:3.0:1787764830.200861:0:8164:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90dcb785e800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.145@tcp at head 00010000:00010000:3.0:1787764830.201178:0:8164:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787764830.201497:0:8164:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787764830.201506:0:8164:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787764830.202430:0:8164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764830.202743:0:8164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787764830.202793:0:8164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787764830.202853:0:8164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787764830.203295:0:8165:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787764830.203300:0:8165:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787764830.204215:0:8164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787764830.204224:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787764830.204262:0:8164:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787764830.204279:0:8164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ec49d1dfa4e232f 00000100:00080000:1.0:1787764830.204288:0:8164:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787764830.204292:0:8164:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90dcb785e800 using connection 192.168.202.145@tcp/0@lo 00000100:00100000:1.0:1787764830.204381:0:8164:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90dc99438b40 x1874607222051072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787764830.204428:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607222051072:0@lo:8: 00000100:00100000:0.0:1787764830.204484:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787764830.204547:0:8164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787764830.204628:0:8164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764830.204632:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764830.204634:0:8164:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787764830.204637:0:8164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764830.204641:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764830.204649:0:8164:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787764830.204653:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787764830.204654:0:8164:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787764830.204675:0:8164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8164:1874607222051200:0@lo:502: 00000100:00100000:1.0:1787764830.204714:0:8164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764830.204732:0:8164:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb7641780 going to sleep for 11 seconds 00000100:00100000:1.0:1787764830.204748:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222051200 00000100:00100000:1.0:1787764830.204753:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222051200 00000100:00100000:1.0:1787764830.204782:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787764830.204790:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+18:8164:x1874607222051200:12345-0@lo:502: 00000100:00100000:2.0:1787764830.205095:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222051072 00000100:00100000:2.0:1787764830.205100:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222051072 00000100:00100000:2.0:1787764830.205123:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787764830.205129:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7838f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1874607222051072:12345-0@lo:8: 00010000:00080000:2.0:1787764830.205148:0:6650:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:2.0:1787764830.205169:0:6650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ec49d1dfa4e2336 00002000:00100000:2.0:1787764830.205181:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90dcbd265800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113976 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787764830.205185:0:6650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787764830.205195:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787764830.205287:0:6650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787764830.205427:0:6650:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787764830.205447:0:6650:0:(import.c:65:import_set_state_nolock()) ffff90dcbd264000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787764830.205548:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+18:8164:x1874607222051200:12345-0@lo:502: Request processed in 758us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.205555:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787764830.205615:0:8164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8164:1874607222051200:0@lo:502: 00000020:01000000:1.0:1787764830.205636:0:8164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764830.205640:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764830.205642:0:8164:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787764830.205645:0:8164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1787764830.205909:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222051712:0@lo:400: 00000100:00100000:3.0:1787764830.205940:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.205962:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764830.205983:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222051328:0@lo:400: 00000100:00100000:3.0:1787764830.206017:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.206043:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222051456:0@lo:400: 00000100:00100000:3.0:1787764830.206065:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.206082:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787764830.206087:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7bd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222051584:0@lo:400: 00000100:00100000:3.0:1787764830.206108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764830.206136:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222051712 00000100:00100000:3.0:1787764830.206141:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222051712 00000100:00100000:3.0:1787764830.206171:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222051328 00000100:00100000:3.0:1787764830.206174:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222051328 00000100:00100000:3.0:1787764830.206186:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222051456 00000100:00100000:3.0:1787764830.206188:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222051456 00000100:00100000:3.0:1787764830.206201:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787764830.206207:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222051712:12345-0@lo:400: 00000100:00100000:3.0:1787764830.206258:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222051712:12345-0@lo:400: Request processed in 39us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.206265:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787764830.206279:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787764830.206286:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222051328:12345-0@lo:400: 00000100:00100000:3.0:1787764830.206467:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222051328:12345-0@lo:400: Request processed in 181us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.206474:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787764830.206487:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787764830.206493:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222051456:12345-0@lo:400: 00000100:00100000:3.0:1787764830.206524:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222051456:12345-0@lo:400: Request processed in 32us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.206530:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787764830.206557:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222051584 00000100:00100000:3.0:1787764830.206560:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222051584 00000100:00100000:3.0:1787764830.206602:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787764830.206609:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222051584:12345-0@lo:400: 00000100:00100000:3.0:1787764830.206636:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222051584:12345-0@lo:400: Request processed in 29us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.206642:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787764830.206656:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764830.206659:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787764830.206681:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb7bd03c0 x1874607222051584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764830.206692:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222051584:0@lo:400: 00010000:00080000:3.0:1787764830.206702:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb7bd0b40 x1874607222051456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764830.206711:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222051456:0@lo:400: 00010000:00080000:3.0:1787764830.206735:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb7bd3840 x1874607222051328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764830.206744:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222051328:0@lo:400: 00010000:00080000:3.0:1787764830.206753:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb7bd12c0 x1874607222051712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787764846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764830.206761:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7bd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222051712:0@lo:400: 00000100:00100000:2.0:1787764830.206962:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7838f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1874607222051072:12345-0@lo:8: Request processed in 1831us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.206981:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787764830.207167:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc99438b40 x1874607222051072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787764840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764830.207176:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787764830.207183:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787764830.207189:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787764830.207199:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787764830.207202:0:3285:0:(import.c:65:import_set_state_nolock()) ffff90dcb785e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787764830.207432:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787764830.207439:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1874607222051072:0@lo:8: 00000020:01000000:0.0:1787764830.207459:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787764830.207477:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787764830.207486:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.207497:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764830.207506:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787764830.207509:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90dc97e31a48 from 1 10000000:01000000:0.0:1787764830.207512:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787764830.207535:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.207542:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.207552:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764830.207564:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7839680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222051840:0@lo:101: 00000100:00100000:0.0:1787764830.207630:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.207654:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a511480 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.207669:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222051840 00000100:00100000:0.0:1787764830.207672:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222051840 00000100:00100000:0.0:1787764830.207697:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787764830.207711:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222051840:12345-0@lo:101: 00010000:00010000:0.0:1787764830.207721:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764830.207733:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e233d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.207753:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.207763:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.207771:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc88586a00, rc 0) 00000100:00100000:0.0:1787764830.207799:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222051840:12345-0@lo:101: Request processed in 90us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.207806:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787764830.207836:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7839680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222051840:0@lo:101: 00010000:00010000:0.0:1787764830.207848:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.207857:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764830.207953:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7839680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222051968:0@lo:501: 00000100:00100000:0.0:1787764830.208045:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.208059:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a511480 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.208071:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222051968 00000100:00100000:0.0:1787764830.208075:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222051968 00000100:00100000:0.0:1787764830.208093:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787764830.208098:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222051968:12345-0@lo:501: 00000100:00100000:0.0:1787764830.208287:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222051968:12345-0@lo:501: Request processed in 187us (241us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764830.208295:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787764830.208384:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7839680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222051968:0@lo:501: 10000000:01000000:0.0:1787764830.208401:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787764830.208405:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764830.208413:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787764830.210579:0:8165:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787764830.211478:0:8165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 139797892343ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787764830.232803:0:8166:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787764830.232839:0:8166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e2883c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8166:1874607222052224:0@lo:7: 00000100:00100000:2.0:1787764830.232913:0:8166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.232955:0:8166:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764830.232979:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222052096:0@lo:13: 00000100:00100000:2.0:1787764830.233011:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.233051:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222052224 00000100:00100000:2.0:1787764830.233057:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222052224 00000100:00100000:2.0:1787764830.233109:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787764830.233119:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e2892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8166:x1874607222052224:12345-0@lo:7: 00000100:00080000:3.0:1787764830.234952:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764830.234988:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222052096 00000100:00100000:3.0:1787764830.234995:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222052096 00000100:00100000:3.0:1787764830.235038:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764830.235047:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e28a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1874607222052096:12345-0@lo:13: 00002000:00000024:3.0:1787764830.235079:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787764830.235147:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e28a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1874607222052096:12345-0@lo:13: Request processed in 101us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764830.235156:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787764830.238666:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e288000 x1874607222052096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764830.238849:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222052096:0@lo:13: 00002000:00080000:2.0:1787764830.240573:0:6845:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787764830.240580:0:6845:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787764830.240685:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e2892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8166:x1874607222052224:12345-0@lo:7: Request processed in 7557us (7763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.240694:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787764830.240969:0:8166:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e2883c0 x1874607222052224/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787764846 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764830.240983:0:8166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e2883c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8166:1874607222052224:0@lo:7: 00000004:00080000:0.0:1787764830.240994:0:8166:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787764830.241029:0:8166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7839680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8166:1874607222052352:0@lo:5: 00000100:00100000:0.0:1787764830.241062:0:8166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.241113:0:8166:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a5113c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764830.241170:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222052352 00000100:00100000:2.0:1787764830.241175:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222052352 00000100:00100000:2.0:1787764830.241266:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787764830.241275:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8166:x1874607222052352:12345-0@lo:5: 00002000:00080000:2.0:1787764830.241299:0:6650:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787764830.241303:0:6650:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787764830.241505:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8166:x1874607222052352:12345-0@lo:5: Request processed in 231us (442us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787764830.241513:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787764830.241663:0:8166:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb7839680 x1874607222052352/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764846 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764830.241675:0:8166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7839680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8166:1874607222052352:0@lo:5: 00000004:00080000:2.0:1787764830.241684:0:8166:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787764830.241705:0:8166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8166:1874607222052480:0@lo:700: 00000100:00100000:2.0:1787764830.241728:0:8166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.241791:0:8166:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.241833:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222052480 00000100:00100000:0.0:1787764830.241838:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222052480 00000100:00100000:0.0:1787764830.241966:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787764830.241975:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e289680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8166:x1874607222052480:12345-0@lo:700: 00000100:00100000:0.0:1787764830.242002:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb78392c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6657:1874607222052608:0@lo:700: 00000100:00100000:0.0:1787764830.242030:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764830.242047:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a511480 going to sleep for 11 seconds 00000100:00100000:2.0:1787764830.242092:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222052608 00000100:00100000:2.0:1787764830.242096:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222052608 00000100:00100000:2.0:1787764830.242163:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787764830.242169:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6657:x1874607222052608:12345-0@lo:700: 00000004:00080000:0.0:1787764830.254084:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787764830.279470:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787764830.282737:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6657:x1874607222052608:12345-0@lo:700: Request processed in 40563us (40701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.282750:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787764830.282954:0:6657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb78392c0 x1874607222052608/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787764846 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764830.282969:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb78392c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6657:1874607222052608:0@lo:700: 40000000:02000000:0.0:1787764830.282981:0:6657:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787764830.321906:0:7605:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787764830.321922:0:7605:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787764830.322098:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e289680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8166:x1874607222052480:12345-0@lo:700: Request processed in 80121us (80365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.322110:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787764830.322197:0:8166:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e288000 x1874607222052480/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787764846 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764830.322210:0:8166:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787764830.322225:0:8166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8166:1874607222052480:0@lo:700: 00000004:02000040:2.0:1787764830.343519:0:8166:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787764830.346034:0:8166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8166:1874607222052736:0@lo:5: 00000100:00100000:2.0:1787764830.346096:0:8166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764830.346145:0:8166:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8394d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787764830.346295:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222052736 00000100:00100000:0.0:1787764830.346302:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222052736 00000100:00100000:0.0:1787764830.346354:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787764830.346363:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e288b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8166:x1874607222052736:12345-0@lo:5: 00002000:00080000:0.0:1787764830.349963:0:6649:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787764830.349980:0:6649:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787764830.352557:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e288b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8166:x1874607222052736:12345-0@lo:5: Request processed in 6191us (6456us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787764830.352569:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787764830.352720:0:8166:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e288000 x1874607222052736/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787764846 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764830.352737:0:8166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8166:1874607222052736:0@lo:5: 00000004:00080000:2.0:1787764830.352749:0:8166:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787764830.480558:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764830.711778:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764830.712070:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214690688 00000100:00100000:0.0:1787764830.712079:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214690688 00000100:00100000:0.0:1787764830.712132:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 109 00000100:00100000:0.0:1787764830.712140:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2363:x1874607214690688:12345-192.168.202.45@tcp:250: 00010000:00080000:0.0:1787764830.712167:0:5798:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 60ac3458-f656-46a2-8942-5ca7481f30b9@192.168.202.45@tcp t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:0.0:1787764830.712200:0:5798:0:(genops.c:1385:class_connect()) connect: client 60ac3458-f656-46a2-8942-5ca7481f30b9, cookie 0x3ec49d1dfa4e234b 00000100:00080000:0.0:1787764830.712345:0:5798:0:(import.c:65:import_set_state_nolock()) ffff90dcbcee2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787764830.712413:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+5:2363:x1874607214690688:12345-192.168.202.45@tcp:250: Request processed in 271us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.712421:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 109 00000100:00100000:1.0:1787764830.714158:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764830.714221:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214690560 00000100:00100000:2.0:1787764830.714230:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214690560 00000100:00100000:2.0:1787764830.714290:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 110 00000100:00100000:2.0:1787764830.714300:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+5:5583:x1874607214690560:12345-192.168.202.45@tcp:101: 00010000:00010000:2.0:1787764830.714311:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764830.714328:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b21d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.714355:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.714366:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.714375:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cf800, rc 0) 00000100:00100000:2.0:1787764830.714418:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+6:5583:x1874607214690560:12345-192.168.202.45@tcp:101: Request processed in 120us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.714425:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 110 00000100:00100000:3.0:1787764830.715206:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764830.717391:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214690816 00000100:00100000:2.0:1787764830.717399:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214690816 00000100:00100000:2.0:1787764830.717447:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 111 00000100:00100000:2.0:1787764830.717456:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+6:5583:x1874607214690816:12345-192.168.202.45@tcp:501: 00000100:00100000:2.0:1787764830.717720:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+6:5583:x1874607214690816:12345-192.168.202.45@tcp:501: Request processed in 265us (2514us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787764830.717728:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 111 00000100:00100000:3.0:1787764830.719221:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764830.719284:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214690944 00000100:00100000:2.0:1787764830.719290:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214690944 00000100:00100000:2.0:1787764830.719338:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 112 00000100:00100000:2.0:1787764830.719347:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+6:5583:x1874607214690944:12345-192.168.202.45@tcp:101: 00010000:00010000:2.0:1787764830.719356:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764830.719370:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b224 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.719391:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.719402:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764830.719410:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cf000, rc 0) 00000100:00100000:2.0:1787764830.719448:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+7:5583:x1874607214690944:12345-192.168.202.45@tcp:101: Request processed in 102us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.719455:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 112 00000100:00100000:1.0:1787764830.720215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764830.720281:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214691072 00000100:00100000:0.0:1787764830.720288:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214691072 00000100:00100000:0.0:1787764830.720324:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 113 00000100:00100000:0.0:1787764830.720341:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+7:5583:x1874607214691072:12345-192.168.202.45@tcp:501: 00000100:00100000:0.0:1787764830.720539:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+8:5583:x1874607214691072:12345-192.168.202.45@tcp:501: Request processed in 198us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.720547:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 113 00000100:00100000:3.0:1787764830.723802:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764830.723928:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214691200 00000100:00100000:0.0:1787764830.723940:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214691200 00000100:00100000:0.0:1787764830.724009:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 114 00000100:00100000:0.0:1787764830.724017:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+8:5583:x1874607214691200:12345-192.168.202.45@tcp:503: 00000100:00100000:0.0:1787764830.724458:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+8:5583:x1874607214691200:12345-192.168.202.45@tcp:503: Request processed in 437us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.724471:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 114 00000100:00100000:3.0:1787764830.726182:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764830.726261:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214691328 00000100:00100000:2.0:1787764830.726268:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214691328 00000100:00100000:2.0:1787764830.726309:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 115 00000100:00100000:2.0:1787764830.726323:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+8:5601:x1874607214691328:12345-192.168.202.45@tcp:502: 00000100:00100000:2.0:1787764830.726569:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+8:5601:x1874607214691328:12345-192.168.202.45@tcp:502: Request processed in 245us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.726577:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 115 00000100:00100000:1.0:1787764830.740738:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764830.740819:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214691456 00000100:00100000:0.0:1787764830.740832:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214691456 00000100:00100000:0.0:1787764830.740918:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 116 00000100:00100000:0.0:1787764830.740930:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+8:5601:x1874607214691456:12345-192.168.202.45@tcp:502: 00000100:00100000:0.0:1787764830.741342:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+8:5601:x1874607214691456:12345-192.168.202.45@tcp:502: Request processed in 410us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764830.741352:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 116 00000100:00100000:3.0:1787764830.743266:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764830.743328:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214691584 00000100:00100000:1.0:1787764830.743344:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214691584 00000100:00100000:1.0:1787764830.743400:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 117 00000100:00100000:1.0:1787764830.743410:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+8:5583:x1874607214691584:12345-192.168.202.45@tcp:101: 00010000:00010000:1.0:1787764830.743439:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764830.743461:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81677e00/0x3ec49d1dfa4e2360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b24e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764830.743503:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81677e00/0x3ec49d1dfa4e2360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b24e expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764830.743516:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81677e00/0x3ec49d1dfa4e2360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b24e expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764830.743527:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81677e00, rc 0) 00000100:00100000:1.0:1787764830.743564:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5583:x1874607214691584:12345-192.168.202.45@tcp:101: Request processed in 157us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.743570:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 117 00000100:00100000:3.0:1787764830.745059:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764830.745110:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214691712 00000100:00100000:2.0:1787764830.745116:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214691712 00000100:00100000:2.0:1787764830.745150:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 118 00000100:00100000:2.0:1787764830.745159:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5583:x1874607214691712:12345-192.168.202.45@tcp:256: 20000000:01000000:2.0:1787764830.745179:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787764830.745203:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787764830.745207:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787764830.745211:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787764830.745213:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787764830.745828:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5583:x1874607214691712:12345-192.168.202.45@tcp:256: Request processed in 669us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.745837:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 118 00000100:00100000:3.0:1787764830.747058:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764830.747120:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214691840 00000100:00100000:1.0:1787764830.747128:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214691840 00000100:00100000:1.0:1787764830.747160:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 119 00000100:00100000:1.0:1787764830.747168:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5583:x1874607214691840:12345-192.168.202.45@tcp:101: 00010000:00010000:1.0:1787764830.747181:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764830.747195:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b255 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764830.747218:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764830.747228:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764830.747258:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81676800, rc 0) 00000100:00100000:1.0:1787764830.747295:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5583:x1874607214691840:12345-192.168.202.45@tcp:101: Request processed in 124us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.747304:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 119 00000100:00100000:3.0:1787764830.747911:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764830.747954:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214691968 00000100:00100000:2.0:1787764830.747958:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214691968 00000100:00100000:2.0:1787764830.747981:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 120 00000100:00100000:2.0:1787764830.747985:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5583:x1874607214691968:12345-192.168.202.45@tcp:501: 00000100:00100000:2.0:1787764830.748216:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5583:x1874607214691968:12345-192.168.202.45@tcp:501: Request processed in 230us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.748222:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 120 00000100:00100000:3.0:1787764830.748860:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764830.748895:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214692096 00000100:00100000:1.0:1787764830.748899:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214692096 00000100:00100000:1.0:1787764830.748920:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 121 00000100:00100000:1.0:1787764830.748924:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5583:x1874607214692096:12345-192.168.202.45@tcp:503: 00000100:00100000:1.0:1787764830.749163:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5583:x1874607214692096:12345-192.168.202.45@tcp:503: Request processed in 238us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.749169:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 121 00000100:00100000:3.0:1787764830.750091:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764830.750136:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214692224 00000100:00100000:2.0:1787764830.750142:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214692224 00000100:00100000:2.0:1787764830.750177:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 122 00000100:00100000:2.0:1787764830.750187:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5606:x1874607214692224:12345-192.168.202.45@tcp:502: 00000100:00100000:2.0:1787764830.750355:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5606:x1874607214692224:12345-192.168.202.45@tcp:502: Request processed in 169us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.750363:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 122 00000100:00100000:3.0:1787764830.751160:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764830.751206:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214692352 00000100:00100000:1.0:1787764830.751211:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214692352 00000100:00100000:1.0:1787764830.751251:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 123 00000100:00100000:1.0:1787764830.751260:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5606:x1874607214692352:12345-192.168.202.45@tcp:502: 00000100:00100000:1.0:1787764830.751371:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5606:x1874607214692352:12345-192.168.202.45@tcp:502: Request processed in 112us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764830.751379:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 123 00000100:00100000:3.0:1787764830.752549:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764830.752625:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214692480 00000100:00100000:0.0:1787764830.752632:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214692480 00000100:00100000:0.0:1787764830.752663:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 4 00000100:00100000:0.0:1787764830.752670:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2363:x1874607214692480:12345-192.168.202.45@tcp:38: 00010000:00080000:0.0:1787764830.752696:0:5805:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:0.0:1787764830.752766:0:5805:0:(genops.c:1385:class_connect()) connect: client 5045b8d5-7523-47ae-bf71-6d43e6178916, cookie 0x3ec49d1dfa4e236e 00000004:00100000:0.0:1787764830.752801:0:5805:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 77 00000001:00000004:0.0:1787764830.752816:0:5805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787764830.763196:0:5805:0:(import.c:65:import_set_state_nolock()) ffff90dcbd267000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787764830.763308:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2363:x1874607214692480:12345-192.168.202.45@tcp:38: Request processed in 10636us (10759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764830.763319:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 4 00010000:00010000:0.0:1787764831.501850:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764831.518835:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764831.518888:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764831.519259:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214692608 00000100:00100000:1.0:1787764831.519274:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214692608 00000100:00100000:1.0:1787764831.519368:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214692736 00000100:00100000:1.0:1787764831.519372:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214692736 00000100:00100000:1.0:1787764831.519404:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 5 00000100:00100000:1.0:1787764831.519420:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+7:0:x1874607214692608:12345-192.168.202.45@tcp:41: 00000100:00100000:2.0:1787764831.519434:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 6 00000100:00100000:2.0:1787764831.519454:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+7:5583:x1874607214692736:12345-192.168.202.45@tcp:41: 00000004:00000024:1.0:1787764831.519494:0:6674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:2.0:1787764831.519499:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787764831.520105:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+7:0:x1874607214692608:12345-192.168.202.45@tcp:41: Request processed in 687us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764831.520115:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 5 00000100:00080000:3.0:1787764831.520257:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764831.520800:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:5583:x1874607214692736:12345-192.168.202.45@tcp:41: Request processed in 1350us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764831.520811:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 6 00000100:00100000:3.0:1787764831.522175:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764831.522277:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214692864 00000100:00100000:0.0:1787764831.522286:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214692864 00000100:00100000:0.0:1787764831.522332:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 7 00000100:00100000:0.0:1787764831.522340:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:5583:x1874607214692864:12345-192.168.202.45@tcp:40: 00000100:00100000:0.0:1787764831.522418:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:5583:x1874607214692864:12345-192.168.202.45@tcp:40: Request processed in 79us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764831.522425:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 7 00000100:00100000:3.0:1787764831.527151:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764831.527277:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764831.527306:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764831.527406:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214692992 00000100:00100000:1.0:1787764831.527421:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214692992 00000100:00100000:0.0:1787764831.527479:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214693120 00000100:00100000:1.0:1787764831.527488:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 8 00000100:00100000:0.0:1787764831.527490:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214693120 00000100:00100000:1.0:1787764831.527501:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1874607214692992:12345-192.168.202.45@tcp:8: 00010000:00080000:1.0:1787764831.527543:0:6650:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp t0 exp 0000000000000000 cur 141 last 0 00000100:00100000:0.0:1787764831.527551:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 9 00000100:00100000:0.0:1787764831.527561:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2363:x1874607214693120:12345-192.168.202.45@tcp:8: 00010000:00080000:0.0:1787764831.527625:0:6648:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:1.0:1787764831.527630:0:6650:0:(genops.c:1385:class_connect()) connect: client 5045b8d5-7523-47ae-bf71-6d43e6178916, cookie 0x3ec49d1dfa4e2375 00002000:00100000:1.0:1787764831.527647:0:6650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5045b8d5-7523-47ae-bf71-6d43e6178916/ffff90dcbd710800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113976 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:0.0:1787764831.527656:0:6648:0:(genops.c:1385:class_connect()) connect: client 5045b8d5-7523-47ae-bf71-6d43e6178916, cookie 0x3ec49d1dfa4e237c 00002000:00100000:1.0:1787764831.527676:0:6650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 77 00002000:00100000:0.0:1787764831.527682:0:6648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5045b8d5-7523-47ae-bf71-6d43e6178916/ffff90dcbcee0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113976 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787764831.527704:0:6648:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 77 00002000:00080000:0.0:1787764831.528062:0:6648:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787764831.528106:0:6648:0:(import.c:65:import_set_state_nolock()) ffff90dcbd597800 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1787764831.528178:0:6650:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1787764831.528186:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2363:x1874607214693120:12345-192.168.202.45@tcp:8: Request processed in 623us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764831.528195:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 9 00000100:00080000:1.0:1787764831.528211:0:6650:0:(import.c:65:import_set_state_nolock()) ffff90dcbd714000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787764831.528281:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2363:x1874607214692992:12345-192.168.202.45@tcp:8: Request processed in 781us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764831.528290:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 8 00000100:00100000:2.0:1787764831.528329:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214693376 00000100:00100000:2.0:1787764831.528335:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214693376 00000100:00100000:2.0:1787764831.528374:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 124 00000100:00100000:2.0:1787764831.528381:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214693376:12345-192.168.202.45@tcp:400: 00000100:00100000:2.0:1787764831.528414:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214693376:12345-192.168.202.45@tcp:400: Request processed in 34us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764831.528421:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 124 00000100:00100000:3.0:1787764831.528725:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764831.532457:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214693248 00000100:00100000:1.0:1787764831.532476:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214693248 00000100:00100000:1.0:1787764831.532545:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 0 00000100:00100000:1.0:1787764831.532556:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:5583:x1874607214693248:12345-192.168.202.45@tcp:33: 00000004:00080000:2.0:1787764831.543610:0:5806:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10942us 00000004:00200000:2.0:1787764831.550648:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787764831.550826:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:5583:x1874607214693248:12345-192.168.202.45@tcp:33: Request processed in 18266us (22096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764831.550841:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 0 00000100:00100000:3.0:1787764831.651921:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764831.651998:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214693504 00000100:00100000:0.0:1787764831.652009:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214693504 00000100:00100000:0.0:1787764831.652060:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 8 00000100:00100000:0.0:1787764831.652069:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:5623:x1874607214693504:12345-192.168.202.45@tcp:101: 00010000:00010000:0.0:1787764831.652101:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764831.652157:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586800/0x3ec49d1dfa4e2383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b27f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764831.652224:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e238a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764831.652254:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e238a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764831.652269:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e238a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764831.652447:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787764831.652451:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787764831.652532:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e238a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764831.652560:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586800/0x3ec49d1dfa4e2383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b27f expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764831.652578:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e238a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b27f expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764831.652635:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002ca00) 00010000:00010000:0.0:1787764831.652638:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787764831.652643:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc88587e00, rc 0) 00000100:00100000:0.0:1787764831.652708:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+7:5623:x1874607214693504:12345-192.168.202.45@tcp:101: Request processed in 640us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764831.652716:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 8 00000100:00100000:3.0:1787764832.206404:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e2883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222052864:0@lo:13: 00000100:00100000:3.0:1787764832.206475:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764832.206688:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222052864 00000100:00100000:2.0:1787764832.206696:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222052864 00000100:00100000:2.0:1787764832.206797:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787764832.206807:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222052864:12345-0@lo:13: 00002000:00000024:2.0:1787764832.206829:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764832.206886:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222052864:12345-0@lo:13: Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764832.206893:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787764832.207036:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e2883c0 x1874607222052864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764832.207055:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e2883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222052864:0@lo:13: 00000100:00080000:3.0:1787764832.207172:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764832.525745:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787764832.786813:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5045b8d5-7523-47ae-bf71-6d43e6178916 00000100:00100000:0.0:1787764833.406880:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764833.407036:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214693632 00000100:00100000:1.0:1787764833.407046:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214693632 00000100:00100000:1.0:1787764833.407234:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 9 00000100:00100000:1.0:1787764833.407245:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb78392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+7:5675:x1874607214693632:12345-192.168.202.45@tcp:41: 00000004:00000024:1.0:1787764833.407291:0:6674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787764833.407369:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb78392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+7:5675:x1874607214693632:12345-192.168.202.45@tcp:41: Request processed in 126us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764833.407388:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 9 00000100:00080000:3.0:1787764833.408038:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764833.411689:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764833.411770:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214693760 00000100:00100000:3.0:1787764833.411786:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214693760 00000100:00100000:3.0:1787764833.411893:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 6 00000100:00100000:3.0:1787764833.411908:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e2883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5045b8d5-7523-47ae-bf71-6d43e6178916+5:5675:x1874607214693760:12345-192.168.202.45@tcp:13: 00002000:00000024:3.0:1787764833.411944:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764833.412046:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e2883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5045b8d5-7523-47ae-bf71-6d43e6178916+5:5675:x1874607214693760:12345-192.168.202.45@tcp:13: Request processed in 140us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764833.412055:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 6 00000100:00080000:0.0:1787764833.412368:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764833.415714:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764833.415801:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214693888 00000100:00100000:3.0:1787764833.415820:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214693888 00000100:00100000:3.0:1787764833.415930:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 7 00000100:00100000:3.0:1787764833.415945:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5045b8d5-7523-47ae-bf71-6d43e6178916+6:5675:x1874607214693888:12345-192.168.202.45@tcp:13: 00002000:00000024:3.0:1787764833.415996:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787764833.416159:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764833.416207:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5045b8d5-7523-47ae-bf71-6d43e6178916+6:5675:x1874607214693888:12345-192.168.202.45@tcp:13: Request processed in 266us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764833.416229:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 7 00010000:00010000:0.0:1787764833.550007:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764834.574248:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764835.280394:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222052992:0@lo:400: 00000100:00100000:0.0:1787764835.280464:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764835.280542:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222052992 00000100:00100000:1.0:1787764835.280549:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222052992 00000100:00100000:1.0:1787764835.280611:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787764835.280622:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222052992:12345-0@lo:400: 00000100:00100000:2.0:1787764835.280698:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222053120:0@lo:400: 00000100:00100000:2.0:1787764835.280730:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764835.280755:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764835.280761:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83c74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222053248:0@lo:400: 00000100:00100000:2.0:1787764835.280782:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764835.282273:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222053504:0@lo:13: 00000100:00100000:0.0:1787764835.282324:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764835.284434:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222053120 00000100:00100000:3.0:1787764835.284447:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222053120 00000100:00100000:3.0:1787764835.284498:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222053248 00000100:00100000:3.0:1787764835.284503:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222053248 00000100:00100000:3.0:1787764835.284535:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787764835.284544:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222053120:12345-0@lo:400: 00000100:00100000:3.0:1787764835.284638:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222053120:12345-0@lo:400: Request processed in 95us (3907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764835.284645:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787764835.284659:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787764835.284678:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222053248:12345-0@lo:400: 00000100:00100000:3.0:1787764835.284707:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222053248:12345-0@lo:400: Request processed in 30us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764835.284713:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787764835.284750:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222053632:0@lo:400: 00000100:00100000:3.0:1787764835.284781:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764835.284820:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222053248:0@lo:400: 00000100:00100000:3.0:1787764835.284831:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222053120:0@lo:400: 00000100:00100000:3.0:1787764835.284859:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222053632 00000100:00100000:3.0:1787764835.284862:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222053632 00000100:00100000:3.0:1787764835.284882:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787764835.284888:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222053632:12345-0@lo:400: 00000100:00100000:3.0:1787764835.284918:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222053632:12345-0@lo:400: Request processed in 29us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764835.284924:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787764835.284950:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222053632:0@lo:400: 00000100:00080000:3.0:1787764835.284985:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764835.284997:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222053504 00000100:00100000:3.0:1787764835.285001:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222053504 00000100:00100000:3.0:1787764835.285032:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787764835.285037:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7839680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607222053504:12345-0@lo:13: 00002000:00000024:3.0:1787764835.285056:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764835.285087:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7839680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607222053504:12345-0@lo:13: Request processed in 50us (2763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764835.285093:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787764835.285118:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222053376:0@lo:400: 00000100:00100000:3.0:1787764835.285145:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787764835.286484:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764835.286523:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222053376 00000100:00100000:3.0:1787764835.286530:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222053376 00000100:00100000:3.0:1787764835.286578:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787764835.286602:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222053376:12345-0@lo:400: 00000100:00100000:3.0:1787764835.286661:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222053376:12345-0@lo:400: Request processed in 60us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764835.286667:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787764835.286686:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787764835.286710:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbcb743c0 x1874607222053376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764835.286724:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222053376:0@lo:400: 00000100:00100000:1.0:1787764835.288065:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222052992:12345-0@lo:400: Request processed in 6460us (6615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764835.288077:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787764835.288319:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222052992:0@lo:400: 00010000:00080000:0.0:1787764835.288352:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb329c780 x1874607222053504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764835.288373:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222053504:0@lo:13: 00000001:02000400:2.0:1787764835.448190:0:8253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787764835.615566:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787764835.846159:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5045b8d5-7523-47ae-bf71-6d43e6178916 00000001:00100000:3.0:1787764835.867875:0:7605:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5045b8d5-7523-47ae-bf71-6d43e6178916 00000001:00080000:3.0:1787764835.867896:0:7605:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787764836.621826:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764836.794212:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764836.794256:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764836.794293:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764836.794323:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764836.794355:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214694016 00000100:00100000:0.0:1787764836.794365:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214694016 00000100:00100000:0.0:1787764836.794432:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 126 00000100:00100000:0.0:1787764836.794443:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214694016:12345-192.168.202.45@tcp:400: 00000100:00100000:0.0:1787764836.794519:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214694016:12345-192.168.202.45@tcp:400: Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764836.794543:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 126 00000100:00100000:3.0:1787764836.795458:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214694144 00000100:00100000:3.0:1787764836.795464:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214694144 00000100:00100000:3.0:1787764836.795528:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 17 00000100:00100000:3.0:1787764836.795536:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214694144:12345-192.168.202.45@tcp:400: 00000100:00100000:3.0:1787764836.795575:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214694144:12345-192.168.202.45@tcp:400: Request processed in 41us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764836.795611:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 17 00000100:00080000:2.0:1787764836.795630:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764836.795636:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214694400 00000100:00100000:3.0:1787764836.795640:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214694400 00000100:00100000:3.0:1787764836.795682:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214694272 00000100:00100000:3.0:1787764836.795685:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214694272 00000100:00080000:2.0:1787764836.795704:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764836.795709:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 5 00000100:00080000:2.0:1787764836.795710:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764836.795719:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2365:x1874607214694400:12345-192.168.202.45@tcp:400: 00000100:00100000:2.0:1787764836.795736:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 6 00000100:00100000:2.0:1787764836.795749:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2365:x1874607214694272:12345-192.168.202.45@tcp:400: 00000100:00100000:3.0:1787764836.795879:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2365:x1874607214694400:12345-192.168.202.45@tcp:400: Request processed in 161us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764836.795886:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 5 00000100:00100000:2.0:1787764836.796214:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2365:x1874607214694272:12345-192.168.202.45@tcp:400: Request processed in 468us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764836.796232:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 6 00000100:00100000:1.0:1787764837.325701:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787764837.325723:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222053760:0@lo:13: 00000100:00100000:1.0:1787764837.325802:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764837.325873:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222053760 00000100:00100000:1.0:1787764837.325881:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222053760 00000100:00100000:1.0:1787764837.325949:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787764837.325961:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc9943b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222053760:12345-0@lo:13: 00002000:00000024:1.0:1787764837.325996:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764837.326044:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc9943b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222053760:12345-0@lo:13: Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764837.326051:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787764837.326095:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc9943a1c0 x1874607222053760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764837.326114:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222053760:0@lo:13: 00000100:00080000:3.0:1787764837.326218:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764837.645713:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787764838.117713:0:8404:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc37aeaab0 20000000:00000080:2.0:1787764838.117731:0:8404:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90dcb7815c00 uarg=0000000000000000 20000000:01000000:2.0:1787764838.117771:0:8404:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787764838.117775:0:8404:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787764838.117778:0:8404:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787764838.117783:0:8404:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787764838.117788:0:8404:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787764838.117803:0:8404:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787764838.117806:0:8404:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787764838.117995:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787764838.117998:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787764838.118735:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787764838.119120:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787764838.119200:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787764838.119242:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787764838.119256:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787764838.119258:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787764838.119748:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787764838.120062:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787764838.120107:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787764838.120159:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787764838.120188:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787764838.120190:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787764838.121046:0:8407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787764838.121321:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787764838.121376:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787764838.121412:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787764838.121424:0:8404:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787764838.121425:0:8404:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787764838.121842:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787764838.122129:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787764838.122202:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787764838.122242:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787764838.122258:0:8404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787764838.122283:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122300:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122308:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122315:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122322:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122329:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122336:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122343:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122352:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122359:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122366:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122406:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122421:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 9 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.122436:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222053888:192.168.202.45@tcp:104: 00010000:00010000:2.0:1787764838.122541:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122550:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 9 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.122559:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054016:192.168.202.45@tcp:104: 00010000:00010000:2.0:1787764838.122611:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122619:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 18 pid: 5796 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.122628:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054144:0@lo:104: 00000100:00100000:2.0:1787764838.122665:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.122709:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222054144 00000100:00100000:1.0:1787764838.122717:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222054144 00010000:00010000:2.0:1787764838.122719:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122729:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.122749:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054272:0@lo:104: 00000100:00100000:1.0:1787764838.122771:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787764838.122779:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.122786:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+3:8404:x1874607222054144:12345-0@lo:104: 00010000:00010000:1.0:1787764838.122800:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122808:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.122819:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787764838.122819:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.122833:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054400:0@lo:104: 00000100:00100000:0.0:1787764838.122838:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787764838.122846:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1787764838.122864:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764838.122867:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764838.122876:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+3:8404:x1874607222054144:12345-0@lo:104: Request processed in 95us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.122887:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787764838.122887:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.122887:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787764838.122897:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.122901:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.122912:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc88587600 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:3.0:1787764838.122916:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.122924:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222054272 00010000:00010000:3.0:1787764838.122924:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.122930:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222054272 10000000:00010000:3.0:1787764838.122937:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764838.122943:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787764838.122950:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222054400 00000100:00100000:1.0:1787764838.122954:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222054400 00000100:00100000:1.0:1787764838.122968:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787764838.122976:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.122977:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbe43b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:8404:x1874607222054272:12345-0@lo:104: 00010000:00010000:3.0:1787764838.122989:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764838.122992:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.123010:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054528:0@lo:104: 00010000:00010000:3.0:1787764838.123012:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123031:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e233d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2344 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.123036:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222054656:0@lo:103: 00000100:00100000:2.0:1787764838.123046:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764838.123046:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787764838.123049:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:3.0:1787764838.123052:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123059:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbe43b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:8404:x1874607222054272:12345-0@lo:104: Request processed in 81us (277us total) trans 0 rc 0/0 00010000:00010000:3.0:1787764838.123062:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc88587200 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:3.0:1787764838.123067:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123073:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787764838.123074:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.123083:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764838.123084:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.123098:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 18 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787764838.123098:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764838.123116:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787764838.123122:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054784:0@lo:104: 00000100:00100000:1.0:1787764838.123125:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222054528 00000100:00100000:1.0:1787764838.123130:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222054528 00010000:00010000:3.0:1787764838.123143:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.123144:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764838.123151:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.123157:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787764838.123159:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222054656 00010000:00010000:3.0:1787764838.123159:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787764838.123165:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222054656 00000100:00100000:1.0:1787764838.123170:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:8404:x1874607222054400:12345-0@lo:104: 00010000:00010000:3.0:1787764838.123172:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.123191:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.123195:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.123204:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 19 pid: 5796 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.123232:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 19 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.123243:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222055040:0@lo:104: 00000100:00100000:0.0:1787764838.123256:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787764838.123256:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764838.123267:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:8404:x1874607222054400:12345-0@lo:104: Request processed in 99us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.123274:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222054656:12345-0@lo:103: 00000100:00100000:2.0:1787764838.123274:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.123284:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787764838.123290:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764838.123298:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 19 pid: 5796 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.123299:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123302:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222054784 00000100:00100000:1.0:1787764838.123308:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222054784 00010000:00010000:2.0:1787764838.123320:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 19 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123328:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222055040 00000100:00100000:2.0:1787764838.123332:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd755a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222055168:0@lo:104: 00000100:00100000:1.0:1787764838.123334:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222055040 00010000:00010000:0.0:1787764838.123336:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 19 pid: 5796 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123336:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc88587200/0x3ec49d1dfa4e2313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e231a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123353:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787764838.123354:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.123360:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787764838.123365:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b39cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1787764838.123366:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123374:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+5:8404:x1874607222054528:12345-0@lo:104: 00010000:00010000:0.0:1787764838.123376:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764838.123383:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc88586a00/0x3ec49d1dfa4e2344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e233d expref: 19 pid: 5796 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.123385:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.123394:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054144:0@lo:104: 00000100:00100000:2.0:1787764838.123406:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054272:0@lo:104: 00000100:00100000:2.0:1787764838.123417:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054400:0@lo:104: 00010000:00010000:3.0:1787764838.123419:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130e00 already unused, calling callback (ffffffffc1c2fc20) 00000100:00100000:0.0:1787764838.123420:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+18:3288:x1874607222054656:12345-0@lo:103: Request processed in 151us (338us total) trans 0 rc 0/0 10000000:00010000:3.0:1787764838.123427:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.123429:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054528:0@lo:104: 00000100:00100000:0.0:1787764838.123434:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787764838.123439:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787764838.123448:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123450:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+5:8404:x1874607222054528:12345-0@lo:104: Request processed in 78us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.123462:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 10000000:00010000:3.0:1787764838.123464:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764838.123471:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764838.123477:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787764838.123480:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222055168 00010000:00010000:0.0:1787764838.123484:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123485:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222055168 00010000:00010000:0.0:1787764838.123502:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940cea00 already unused, calling callback (ffffffffc1c2fc20) 00010000:00010000:3.0:1787764838.123502:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764838.123508:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123512:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787764838.123515:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787764838.123525:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123527:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+5:8404:x1874607222054784:12345-0@lo:104: 00010000:00010000:3.0:1787764838.123535:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.123540:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222055296:0@lo:103: 10000000:00010000:0.0:1787764838.123542:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.123543:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123548:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc93130e00/0x3ec49d1dfa4e22f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764838.123565:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787764838.123572:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764838.123576:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764838.123600:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764838.123602:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764838.123625:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.123630:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222055296 00010000:00010000:0.0:1787764838.123634:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787764838.123636:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222055296 00010000:00010000:1.0:1787764838.123640:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764838.123647:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+5:8404:x1874607222054784:12345-0@lo:104: Request processed in 123us (499us total) trans 0 rc 0/0 00010000:00010000:0.0:1787764838.123656:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123658:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.123664:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054784:0@lo:104: 00000100:00100000:1.0:1787764838.123674:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787764838.123678:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc940cea00/0x3ec49d1dfa4e22e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22f0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123695:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1787764838.123696:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764838.123703:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123709:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd754b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:8404:x1874607222055040:12345-0@lo:104: 00010000:00010000:0.0:1787764838.123717:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131c00 already unused, calling callback (ffffffffc1c2fc20) 00010000:00010000:1.0:1787764838.123724:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764838.123725:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.123729:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787764838.123744:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd755e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+18:3286:x1874607222055296:12345-0@lo:103: 00010000:00010000:0.0:1787764838.123760:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764838.123767:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764838.123773:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787764838.123779:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764838.123787:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd754b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:8404:x1874607222055040:12345-0@lo:104: Request processed in 83us (517us total) trans 0 rc 0/0 00010000:00010000:0.0:1787764838.123793:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.123795:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222055040:0@lo:104: 00000100:00100000:1.0:1787764838.123796:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787764838.123807:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764838.123808:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787764838.123816:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.123818:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123822:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787764838.123836:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc93131c00/0x3ec49d1dfa4e22db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22e2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123837:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123838:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd756940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+3:8404:x1874607222055168:12345-0@lo:104: 00010000:00010000:1.0:1787764838.123853:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123864:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e22fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22f7 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.123872:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764838.123877:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.123880:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764838.123887:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc81677a00 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:0.0:1787764838.123891:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.123895:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787764838.123902:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123905:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd756940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+3:8404:x1874607222055168:12345-0@lo:104: Request processed in 71us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.123908:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd755a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222055168:0@lo:104: 00000100:00100000:3.0:1787764838.123919:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd755e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+17:3286:x1874607222055296:12345-0@lo:103: Request processed in 177us (348us total) trans 0 rc 0/0 10000000:00010000:0.0:1787764838.123921:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.123925:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787764838.123936:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:01000000:0.0:1787764838.123943:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764838.123962:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.123969:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764838.123974:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.123981:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc81677a00/0x3ec49d1dfa4e22b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22b8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.123992:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764838.123995:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.124001:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc81676200 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:0.0:1787764838.124004:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.124011:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764838.124018:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764838.124024:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787764838.124038:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.124039:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764838.124047:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764838.124061:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.124068:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc81676200/0x3ec49d1dfa4e2287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e228e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.124084:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764838.124087:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764838.124090:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764838.124103:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222054912:0@lo:103: 00000100:00100000:0.0:1787764838.124135:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.124161:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222055680:0@lo:103: 00000100:00100000:1.0:1787764838.124170:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222054912 00000100:00100000:1.0:1787764838.124190:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222054912 00010000:00010000:1.0:1787764838.124209:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 17 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.124213:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.124242:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787764838.124245:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222055680 00000100:00100000:1.0:1787764838.124249:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222055680 00000100:00100000:0.0:1787764838.124253:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb783b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222055552:0@lo:103: 00000100:00100000:2.0:1787764838.124255:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787764838.124262:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.124268:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+18:3289:x1874607222054912:12345-0@lo:103: 00010000:00010000:2.0:1787764838.124280:0:6665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764838.124289:0:6665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.124291:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787764838.124301:0:6665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.124312:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc93131e00/0x3ec49d1dfa4e231a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2313 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.124313:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222055552 00000100:00100000:1.0:1787764838.124320:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222055552 00010000:00010000:2.0:1787764838.124324:0:6665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764838.124329:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb7838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222055424:0@lo:103: 00000100:00100000:3.0:1787764838.124330:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787764838.124338:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 18 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.124344:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+18:3289:x1874607222055680:12345-0@lo:103: 00010000:00010000:3.0:1787764838.124357:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787764838.124358:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+18:3289:x1874607222054912:12345-0@lo:103: Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.124361:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:3.0:1787764838.124365:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.124372:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1787764838.124373:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.124373:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787764838.124386:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.124392:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222055424 00000100:00100000:2.0:1787764838.124396:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222055424 00000100:00100000:0.0:1787764838.124397:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1787764838.124400:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e22b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22b1 expref: 17 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.124407:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222055808:0@lo:103: 00010000:00010000:2.0:1787764838.124410:0:6665:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 18 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.124433:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764838.124439:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787764838.124442:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.124451:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+17:3289:x1874607222055552:12345-0@lo:103: 00010000:00010000:2.0:1787764838.124462:0:6665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764838.124467:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764838.124467:0:6665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 17 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.124473:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+17:3289:x1874607222055680:12345-0@lo:103: Request processed in 131us (260us total) trans 0 rc 0/0 00010000:00010000:2.0:1787764838.124481:0:6665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 17 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.124486:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787764838.124497:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222055296:0@lo:103: 00000100:00100000:3.0:1787764838.124504:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222055808 00000100:00100000:3.0:1787764838.124509:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222055808 00010000:00010000:2.0:1787764838.124517:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940ce600/0x3ec49d1dfa4e22e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22db expref: 17 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.124526:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 16 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.124528:0:6665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764838.124535:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222054656:0@lo:103: 00000100:00100000:3.0:1787764838.124549:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787764838.124558:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+16:3287:x1874607222055424:12345-0@lo:103: 00000100:00100000:2.0:1787764838.124566:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+16:3289:x1874607222055552:12345-0@lo:103: Request processed in 115us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1787764838.124567:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764838.124574:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 16 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.124578:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787764838.124607:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb783b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222055552:0@lo:103: 00010000:00010000:3.0:1787764838.124614:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 16 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.124628:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222054912:0@lo:103: 00010000:00010000:3.0:1787764838.124630:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e22f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22e9 expref: 16 pid: 5798 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.124645:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764838.124656:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222055680:0@lo:103: 00000100:00100000:3.0:1787764838.124686:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+15:3287:x1874607222055424:12345-0@lo:103: Request processed in 128us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.124701:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb7838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222055424:0@lo:103: 00000100:00100000:3.0:1787764838.124860:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787764838.124872:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787764838.124879:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+13:3287:x1874607222055808:12345-0@lo:103: 00010000:00010000:2.0:1787764838.124887:0:6665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764838.124892:0:6665:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 13 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.124902:0:6665:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 13 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.124911:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc88587400/0x3ec49d1dfa4e228e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2287 expref: 13 pid: 5797 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.124920:0:6665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764838.124956:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3db9464f-230d-4339-9306-352e25163ce7+12:3287:x1874607222055808:12345-0@lo:103: Request processed in 77us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.124962:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787764838.124990:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222055808:0@lo:103: 00000100:00100000:2.0:1787764838.126904:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764838.126930:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214694528 00000100:00100000:2.0:1787764838.126937:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764838.126939:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214694528 00000100:00100000:2.0:1787764838.126971:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00010000:00010000:3.0:1787764838.126977:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 10 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.126996:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214694656 00000100:00100000:2.0:1787764838.127001:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214694656 00000100:00100000:3.0:1787764838.127025:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214694784 00000100:00100000:3.0:1787764838.127029:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214694784 00000100:00100000:2.0:1787764838.127046:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 127 00010000:00010000:3.0:1787764838.127047:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 12 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.127059:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+12:5597:x1874607214694656:12345-192.168.202.45@tcp:101: 00010000:00010000:2.0:1787764838.127072:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787764838.127072:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 19 00000100:00100000:3.0:1787764838.127083:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd755e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60ac3458-f656-46a2-8942-5ca7481f30b9+12:2364:x1874607214694528:12345-192.168.202.45@tcp:103: 00010000:00010000:2.0:1787764838.127088:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940cf400/0x3ec49d1dfa4e2398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b286 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127095:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764838.127102:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 13 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.127111:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.127130:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90dc940cf400/0x3ec49d1dfa4e2398 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b286 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127144:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 13 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.127293:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222053888:192.168.202.45@tcp:104: 00000100:00100000:0.0:1787764838.127309:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8404:1874607222054016:192.168.202.45@tcp:104: 00010000:00010000:2.0:1787764838.127411:0:5798:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127413:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e2359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b224 expref: 13 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127436:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764838.127440:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940cf400/0x3ec49d1dfa4e2398 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b286 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.127449:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cf400, rc 0) 00000100:00100000:3.0:1787764838.127487:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd755e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60ac3458-f656-46a2-8942-5ca7481f30b9+12:2364:x1874607214694528:12345-192.168.202.45@tcp:103: Request processed in 405us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764838.127494:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 19 00000100:00100000:3.0:1787764838.127509:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 20 00000100:00100000:3.0:1787764838.127515:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd754780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60ac3458-f656-46a2-8942-5ca7481f30b9+11:2365:x1874607214694784:12345-192.168.202.45@tcp:103: 00010000:00010000:3.0:1787764838.127522:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764838.127527:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 11 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127547:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 11 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127569:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e2352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b21d expref: 11 pid: 5797 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127579:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127657:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.127673:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127674:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.127696:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127696:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.127717:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127718:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127737:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127745:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940cee00 already unused, calling callback (ffffffffc15ff530) 00010000:00010000:3.0:1787764838.127749:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127757:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127778:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90dc940cf400/0x3ec49d1dfa4e2398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b286 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127786:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940cf400/0x3ec49d1dfa4e2398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b286 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.127808:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff90dc940cf400/0x3ec49d1dfa4e2398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b286 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.127819:0:5790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5790:1874607222055936:192.168.202.45@tcp:105: 00000100:00100000:2.0:1787764838.127904:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214694656:12345-192.168.202.45@tcp:101: Request processed in 847us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.127911:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 127 00000100:00100000:3.0:1787764838.128120:0:5790:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc88356480 going to sleep for 11 seconds 00000100:00100000:3.0:1787764838.133365:0:5790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5790:1874607222055936:192.168.202.45@tcp:105: 00010000:00010000:3.0:1787764838.133398:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.133411:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940cee00/0x3ec49d1dfa4e2391 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.133426:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787764838.133488:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd754780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60ac3458-f656-46a2-8942-5ca7481f30b9+9:2365:x1874607214694784:12345-192.168.202.45@tcp:103: Request processed in 5972us (6515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764838.133498:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 20 00000100:00100000:0.0:1787764838.141569:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764838.141678:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214694912 00000100:00100000:1.0:1787764838.141688:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214694912 00000100:00100000:1.0:1787764838.141751:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 128 00000100:00100000:1.0:1787764838.141763:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5597:x1874607214694912:12345-192.168.202.45@tcp:501: 00000100:00100000:1.0:1787764838.142108:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5597:x1874607214694912:12345-192.168.202.45@tcp:501: Request processed in 345us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.142116:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 128 00000100:00100000:3.0:1787764838.150287:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764838.150374:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214695040 00000100:00100000:1.0:1787764838.150388:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214695040 00000100:00100000:1.0:1787764838.150482:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 129 00000100:00100000:1.0:1787764838.150499:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5597:x1874607214695040:12345-192.168.202.45@tcp:503: 00000100:00100000:1.0:1787764838.150843:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5597:x1874607214695040:12345-192.168.202.45@tcp:503: Request processed in 349us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.150852:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 129 00000100:00100000:3.0:1787764838.155748:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764838.156639:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214695168 00000100:00100000:1.0:1787764838.156653:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214695168 00000100:00100000:1.0:1787764838.156730:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 130 00000100:00100000:1.0:1787764838.156741:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+9:6058:x1874607214695168:12345-192.168.202.45@tcp:502: 00000100:00100000:1.0:1787764838.157070:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+9:6058:x1874607214695168:12345-192.168.202.45@tcp:502: Request processed in 330us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.157079:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 130 00000100:00100000:0.0:1787764838.164616:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764838.164698:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214695296 00000100:00100000:2.0:1787764838.164710:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214695296 00000100:00100000:2.0:1787764838.164780:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 131 00000100:00100000:2.0:1787764838.164792:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+9:6058:x1874607214695296:12345-192.168.202.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787764838.165134:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+9:6058:x1874607214695296:12345-192.168.202.45@tcp:502:llog_process_th.0 Request processed in 343us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.165158:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 131 00000100:00100000:3.0:1787764838.169245:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764838.169428:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214695424 00000100:00100000:1.0:1787764838.169480:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214695424 00000100:00100000:1.0:1787764838.169622:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 132 00000100:00100000:1.0:1787764838.169634:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5597:x1874607214695424:12345-192.168.202.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764838.169655:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764838.169684:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81676e00/0x3ec49d1dfa4e239f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b28d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.169717:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81676e00/0x3ec49d1dfa4e239f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b28d expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.169730:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81676e00/0x3ec49d1dfa4e239f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b28d expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.169741:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81676e00, rc 0) 00000100:00100000:1.0:1787764838.169797:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214695424:12345-192.168.202.45@tcp:101:ll_cfg_requeue.0 Request processed in 165us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.169813:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 132 00000100:00100000:3.0:1787764838.184060:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764838.184149:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214695552 00000100:00100000:0.0:1787764838.184160:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214695552 00000100:00100000:0.0:1787764838.184302:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 133 00000100:00100000:0.0:1787764838.184315:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214695552:12345-192.168.202.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.184984:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214695552:12345-192.168.202.45@tcp:501:ll_cfg_requeue.0 Request processed in 670us (934us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787764838.184995:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 133 10000000:01000000:0.0:1787764838.581664:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787764838.581672:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dcbd590000 from 39 10000000:01000000:0.0:1787764838.581678:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787764838.581722:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88586e00/0x3ec49d1dfa4e23a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.581743:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc88586e00/0x3ec49d1dfa4e23a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.581755:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc88586e00/0x3ec49d1dfa4e23a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.581777:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056064:0@lo:101: 00000100:00100000:0.0:1787764838.581838:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.581884:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b994000 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.582209:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222056064 00000100:00100000:1.0:1787764838.582216:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222056064 00000100:00100000:1.0:1787764838.582287:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787764838.582297:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+12:5800:x1874607222056064:12345-0@lo:101: 00010000:00010000:1.0:1787764838.582317:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764838.582329:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e23ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e23a6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.582352:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e23ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23a6 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.582361:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81676000/0x3ec49d1dfa4e23ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23a6 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.582370:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81676000, rc 0) 00000100:00100000:1.0:1787764838.582415:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222056064:12345-0@lo:101: Request processed in 119us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.582422:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787764838.582455:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056064:0@lo:101: 00010000:00010000:0.0:1787764838.582470:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc88586e00/0x3ec49d1dfa4e23a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23ad expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.582480:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc88586e00/0x3ec49d1dfa4e23a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e23ad expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.582531:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056192:0@lo:501: 00000100:00100000:0.0:1787764838.582558:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.582614:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b994000 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.585464:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222056192 00000100:00100000:1.0:1787764838.585475:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222056192 00000100:00100000:1.0:1787764838.585528:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787764838.585538:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222056192:12345-0@lo:501: 00000100:00100000:1.0:1787764838.585889:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222056192:12345-0@lo:501: Request processed in 351us (3328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.585898:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787764838.585960:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056192:0@lo:501: 00000100:00100000:1.0:1787764838.586022:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056320:0@lo:503: 00000100:00100000:1.0:1787764838.586071:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.586112:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc940a6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787764838.587378:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222056320 00000100:00100000:2.0:1787764838.587386:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222056320 00000100:00100000:2.0:1787764838.587434:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787764838.587443:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222056320:12345-0@lo:503: 00000100:00100000:2.0:1787764838.587641:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222056320:12345-0@lo:503: Request processed in 198us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.587648:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787764838.587747:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056320:0@lo:503: 00000100:00100000:3.0:1787764838.588277:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8431:1874607222056448:0@lo:502: 00000100:00100000:3.0:1787764838.588320:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764838.588354:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc88356480 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.588401:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222056448 00000100:00100000:1.0:1787764838.588406:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222056448 00000100:00100000:1.0:1787764838.588435:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787764838.588441:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:8431:x1874607222056448:12345-0@lo:502: 00000100:00100000:1.0:1787764838.588614:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:8431:x1874607222056448:12345-0@lo:502: Request processed in 172us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.588621:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787764838.589557:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8431:1874607222056448:0@lo:502: 00000100:00100000:3.0:1787764838.589617:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8431:1874607222056576:0@lo:502: 00000100:00100000:3.0:1787764838.589653:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764838.589675:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc88356480 going to sleep for 11 seconds 00000100:00100000:2.0:1787764838.589980:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222056576 00000100:00100000:2.0:1787764838.589985:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222056576 00000100:00100000:2.0:1787764838.590065:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787764838.590074:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:8431:x1874607222056576:12345-0@lo:502: 00000100:00100000:2.0:1787764838.590286:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+13:8431:x1874607222056576:12345-0@lo:502: Request processed in 214us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.590294:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787764838.590355:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8431:1874607222056576:0@lo:502: 00000040:00080000:3.0:1787764838.590375:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787764838.590547:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787764838.590570:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787764838.590580:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88586e00/0x3ec49d1dfa4e23a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23ad expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.590615:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc88586e00/0x3ec49d1dfa4e23a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23ad expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764838.590625:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787764838.590628:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787764838.590630:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787764838.590654:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81676600/0x3ec49d1dfa4e23b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.590662:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc81676600/0x3ec49d1dfa4e23b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.590670:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc81676600/0x3ec49d1dfa4e23b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.590682:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056704:0@lo:101: 00000100:00100000:1.0:1787764838.590709:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.590733:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb7641900 going to sleep for 11 seconds 00000100:00100000:3.0:1787764838.590784:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222056704 00000100:00100000:3.0:1787764838.590789:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222056704 00000100:00100000:3.0:1787764838.590807:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787764838.590814:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+13:5800:x1874607222056704:12345-0@lo:101: 00010000:00010000:3.0:1787764838.590822:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764838.590833:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e23bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e23b4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.590853:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e23bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23b4 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.590865:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc93130800/0x3ec49d1dfa4e23bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23b4 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.590874:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc93130800, rc 0) 00000100:00100000:3.0:1787764838.590913:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222056704:12345-0@lo:101: Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764838.590919:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787764838.591069:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056704:0@lo:101: 00010000:00010000:1.0:1787764838.591089:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc81676600/0x3ec49d1dfa4e23b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23bb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.591098:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc81676600/0x3ec49d1dfa4e23b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e23bb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.591140:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056832:0@lo:501: 00000100:00100000:1.0:1787764838.591166:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.591201:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb7641900 going to sleep for 11 seconds 00000100:00100000:3.0:1787764838.591359:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222056832 00000100:00100000:3.0:1787764838.591363:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222056832 00000100:00100000:3.0:1787764838.591382:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787764838.591389:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222056832:12345-0@lo:501: 00000100:00100000:3.0:1787764838.591614:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222056832:12345-0@lo:501: Request processed in 224us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764838.591621:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787764838.591690:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056832:0@lo:501: 00000100:00100000:1.0:1787764838.591716:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056960:0@lo:503: 00000100:00100000:1.0:1787764838.591750:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.591773:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb7641900 going to sleep for 11 seconds 00000100:00100000:3.0:1787764838.591814:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222056960 00000100:00100000:3.0:1787764838.591818:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222056960 00000100:00100000:3.0:1787764838.591836:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787764838.591842:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222056960:12345-0@lo:503: 00000100:00100000:3.0:1787764838.591971:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222056960:12345-0@lo:503: Request processed in 128us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764838.591978:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787764838.592042:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222056960:0@lo:503: 00000100:00100000:1.0:1787764838.592354:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8433:1874607222057088:0@lo:502: 00000100:00100000:1.0:1787764838.592386:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.592409:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb76419c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787764838.592447:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222057088 00000100:00100000:3.0:1787764838.592453:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222057088 00000100:00100000:3.0:1787764838.592479:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787764838.592486:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:8433:x1874607222057088:12345-0@lo:502: 00000100:00100000:3.0:1787764838.592617:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:8433:x1874607222057088:12345-0@lo:502: Request processed in 131us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764838.592623:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787764838.594366:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8433:1874607222057088:0@lo:502: 00000020:01000000:1.0:1787764838.594398:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764838.594408:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764838.594410:0:8433:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787764838.594417:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787764838.594448:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8433:1874607222057216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.594501:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.594543:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb76419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764838.594612:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222057216 00000100:00100000:2.0:1787764838.594617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222057216 00000100:00100000:2.0:1787764838.594649:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787764838.594656:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:8433:x1874607222057216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764838.594823:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+14:8433:x1874607222057216:12345-0@lo:502:llog_process_th.0 Request processed in 167us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.594828:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787764838.594920:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8433:1874607222057216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787764838.594939:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764838.594942:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764838.594943:0:8433:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787764838.594946:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787764838.595056:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787764838.595074:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787764838.595080:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc81676600/0x3ec49d1dfa4e23b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23bb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.595095:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc81676600/0x3ec49d1dfa4e23b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23bb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764838.595102:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787764838.595104:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dc89161000 from 39 10000000:01000000:2.0:1787764838.595106:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787764838.595124:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cfe00/0x3ec49d1dfa4e23c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.595129:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc940cfe00/0x3ec49d1dfa4e23c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.595135:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc940cfe00/0x3ec49d1dfa4e23c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.595145:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222057344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.595183:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.595253:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.596250:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222057344 00000100:00100000:1.0:1787764838.596260:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222057344 00000100:00100000:1.0:1787764838.596311:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787764838.596321:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+14:5800:x1874607222057344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764838.596335:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764838.596349:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81677000/0x3ec49d1dfa4e23c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e23c2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.596393:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81677000/0x3ec49d1dfa4e23c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23c2 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.596405:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81677000/0x3ec49d1dfa4e23c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23c2 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.596414:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81677000, rc 0) 00000100:00100000:1.0:1787764838.596472:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222057344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.596478:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787764838.596517:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222057344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764838.596533:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc940cfe00/0x3ec49d1dfa4e23c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23c9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.596542:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc940cfe00/0x3ec49d1dfa4e23c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e23c9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.596706:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222057472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764838.596736:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.596803:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb76419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.596820:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222057472 00000100:00100000:1.0:1787764838.596824:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222057472 00000100:00100000:0.0:1787764838.596865:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787764838.596875:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222057472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.597098:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222057472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.597105:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787764838.597133:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222057472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.597167:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222057600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.597211:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.597224:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b994180 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.597235:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222057600 00000100:00100000:0.0:1787764838.597239:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222057600 00000100:00100000:0.0:1787764838.597260:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787764838.597266:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222057600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.597408:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222057600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.597415:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787764838.597431:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222057600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764838.597751:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8434:1874607222057728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.597786:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.597814:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb7641b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.597821:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222057728 00000100:00100000:0.0:1787764838.597827:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222057728 00000100:00100000:0.0:1787764838.597864:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787764838.597873:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:8434:x1874607222057728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764838.598071:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:8434:x1874607222057728:12345-0@lo:502:llog_process_th.0 Request processed in 199us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.598078:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787764838.598150:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8434:1874607222057728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.598198:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8434:1874607222057856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.598221:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.598235:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb7641b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.598253:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222057856 00000100:00100000:0.0:1787764838.598258:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222057856 00000100:00100000:0.0:1787764838.598282:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787764838.598288:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:8434:x1874607222057856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764838.598425:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+15:8434:x1874607222057856:12345-0@lo:502:llog_process_th.0 Request processed in 136us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.598433:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787764838.598449:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8434:1874607222057856:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787764838.598472:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787764838.598657:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787764838.598684:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787764838.598693:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940cfe00/0x3ec49d1dfa4e23c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23c9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.598700:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc940cfe00/0x3ec49d1dfa4e23c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23c9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764838.598707:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787764838.598714:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787764838.598716:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787764838.598735:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940ce000/0x3ec49d1dfa4e23d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.598740:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc940ce000/0x3ec49d1dfa4e23d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.598745:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc940ce000/0x3ec49d1dfa4e23d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.598754:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222057984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.598781:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.598807:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.598816:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222057984 00000100:00100000:0.0:1787764838.598821:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222057984 00000100:00100000:0.0:1787764838.598866:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787764838.598874:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+15:5800:x1874607222057984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764838.598883:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764838.598895:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc88586000/0x3ec49d1dfa4e23d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e23d0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.598919:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc88586000/0x3ec49d1dfa4e23d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23d0 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.598930:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc88586000/0x3ec49d1dfa4e23d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23d0 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.598939:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc88586000, rc 0) 00000100:00100000:0.0:1787764838.598971:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222057984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.598978:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787764838.599001:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222057984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764838.599014:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc940ce000/0x3ec49d1dfa4e23d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.599020:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc940ce000/0x3ec49d1dfa4e23d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e23d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.599050:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.599067:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.599082:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.599098:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222058112 00000100:00100000:0.0:1787764838.599103:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222058112 00000100:00100000:0.0:1787764838.599139:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787764838.599147:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222058112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.599340:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222058112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.599347:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787764838.599395:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.599428:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.599468:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.599491:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.599656:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222058240 00000100:00100000:0.0:1787764838.599661:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222058240 00000100:00100000:0.0:1787764838.599700:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787764838.599708:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222058240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.599865:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222058240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.599879:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787764838.599970:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764838.602300:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8436:1874607222058368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.602418:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.602458:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb7641000 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.602462:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222058368 00000100:00100000:0.0:1787764838.602469:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222058368 00000100:00100000:0.0:1787764838.602517:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787764838.602527:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:8436:x1874607222058368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.602879:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:8436:x1874607222058368:12345-0@lo:502:llog_process_th.0 Request processed in 353us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.602888:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787764838.602902:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9943ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8436:1874607222058368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787764838.602935:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787764838.602944:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764838.602947:0:8436:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787764838.602953:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787764838.602973:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8436:1874607222058496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764838.603009:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.603036:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.603047:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222058496 00000100:00100000:1.0:1787764838.603052:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222058496 00000100:00100000:1.0:1787764838.603088:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787764838.603096:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:8436:x1874607222058496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.605285:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:8436:x1874607222058496:12345-0@lo:502:llog_process_th.0 Request processed in 2184us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.605298:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787764838.605325:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8436:1874607222058496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787764838.605362:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764838.605369:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764838.605371:0:8436:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787764838.605377:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787764838.605528:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787764838.605556:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787764838.605565:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940ce000/0x3ec49d1dfa4e23d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.605576:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc940ce000/0x3ec49d1dfa4e23d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764838.605603:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787764838.605606:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90dc85d67000 from 39 10000000:01000000:2.0:1787764838.605609:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787764838.605639:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940ce600/0x3ec49d1dfa4e23de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.605647:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc940ce600/0x3ec49d1dfa4e23de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.605655:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc940ce600/0x3ec49d1dfa4e23de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764838.605674:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.605712:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.605743:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.605766:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222058624 00000100:00100000:1.0:1787764838.605773:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222058624 00000100:00100000:1.0:1787764838.605851:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787764838.605862:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222058624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764838.605873:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764838.605886:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e23e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e23de expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.605908:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e23e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23de expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.605919:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81677a00/0x3ec49d1dfa4e23e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23de expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.605928:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81677a00, rc 0) 00000100:00100000:1.0:1787764838.605963:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222058624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.605971:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787764838.605993:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764838.606006:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc940ce600/0x3ec49d1dfa4e23de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.606017:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc940ce600/0x3ec49d1dfa4e23de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e23e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.606067:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.606101:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.606535:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222058752 00000100:00100000:2.0:1787764838.606542:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222058752 00000100:00100000:0.0:1787764838.606549:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764838.606572:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787764838.606580:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222058752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.606871:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222058752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.606884:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787764838.606896:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.606929:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.606974:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.607008:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.607015:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222058880 00000100:00100000:1.0:1787764838.607021:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222058880 00000100:00100000:1.0:1787764838.607044:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787764838.607052:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222058880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764838.607262:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222058880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.607279:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787764838.607379:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222058880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.607722:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8437:1874607222059008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764838.607753:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.607785:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.607798:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222059008 00000100:00100000:1.0:1787764838.607804:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222059008 00000100:00100000:1.0:1787764838.607842:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787764838.607850:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+17:8437:x1874607222059008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.608038:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+17:8437:x1874607222059008:12345-0@lo:502:llog_process_th.0 Request processed in 187us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.608047:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787764838.608060:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8437:1874607222059008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764838.608095:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8437:1874607222059136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764838.608118:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764838.608131:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8879e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.608141:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222059136 00000100:00100000:1.0:1787764838.608147:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222059136 00000100:00100000:1.0:1787764838.608191:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787764838.608199:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:8437:x1874607222059136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.608365:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:8437:x1874607222059136:12345-0@lo:502:llog_process_th.0 Request processed in 167us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.608373:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787764838.608395:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8437:1874607222059136:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787764838.608416:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787764838.608533:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787764838.608552:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787764838.608560:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc940ce600/0x3ec49d1dfa4e23de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.608569:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc940ce600/0x3ec49d1dfa4e23de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764838.608577:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787764838.608579:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787764838.608792:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787764838.608815:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587000/0x3ec49d1dfa4e23ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.608825:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc88587000/0x3ec49d1dfa4e23ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.608835:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc88587000/0x3ec49d1dfa4e23ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.608848:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222059264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.608885:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.608912:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.608925:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222059264 00000100:00100000:1.0:1787764838.608931:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222059264 00000100:00100000:1.0:1787764838.608963:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787764838.608969:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222059264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764838.608976:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764838.608986:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81677c00/0x3ec49d1dfa4e23f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e23ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.609002:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81677c00/0x3ec49d1dfa4e23f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23ec expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.609009:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81677c00/0x3ec49d1dfa4e23f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23ec expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.609020:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81677c00, rc 0) 00000100:00100000:1.0:1787764838.609043:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222059264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.609047:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787764838.609152:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222059264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764838.609164:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc88587000/0x3ec49d1dfa4e23ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.609188:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc88587000/0x3ec49d1dfa4e23ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e23f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.609230:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222059392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.609255:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.609272:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.609297:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222059392 00000100:00100000:0.0:1787764838.609301:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222059392 00000100:00100000:0.0:1787764838.609330:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787764838.609340:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222059392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.609534:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222059392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.609542:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787764838.609663:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222059392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764838.609692:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222059520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764838.609726:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.609757:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787764838.609871:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222059520 00000100:00100000:2.0:1787764838.609876:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222059520 00000100:00100000:2.0:1787764838.609906:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787764838.609914:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222059520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.610040:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222059520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.610049:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787764838.610062:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222059520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764838.610975:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8438:1874607222059648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.611010:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.611032:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764838.611041:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222059648 00000100:00100000:0.0:1787764838.611047:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222059648 00000100:00100000:0.0:1787764838.611080:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787764838.611089:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:8438:x1874607222059648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764838.611308:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:8438:x1874607222059648:12345-0@lo:502:llog_process_th.0 Request processed in 219us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.611318:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787764838.611318:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8438:1874607222059648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787764838.611341:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787764838.611349:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764838.611351:0:8438:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787764838.611356:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787764838.611371:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8438:1874607222059776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764838.611396:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.611412:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764838.611436:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222059776 00000100:00100000:2.0:1787764838.611441:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222059776 00000100:00100000:2.0:1787764838.611468:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787764838.611475:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:8438:x1874607222059776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764838.611645:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:8438:x1874607222059776:12345-0@lo:502:llog_process_th.0 Request processed in 170us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764838.611653:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787764838.611684:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8438:1874607222059776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787764838.611708:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787764838.611713:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787764838.611719:0:8438:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787764838.611724:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787764838.611799:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787764838.611821:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787764838.611830:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587000/0x3ec49d1dfa4e23ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.611840:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc88587000/0x3ec49d1dfa4e23ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e23f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764838.611849:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787764838.611852:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90dc97e31a48 from 1 10000000:01000000:0.0:1787764838.611854:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787764838.611875:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88586600/0x3ec49d1dfa4e23fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.611884:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc88586600/0x3ec49d1dfa4e23fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.611893:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc88586600/0x3ec49d1dfa4e23fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.611907:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222059904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.611949:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.611986:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222059904 00000100:00100000:1.0:1787764838.611991:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222059904 00000100:00100000:0.0:1787764838.611992:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787764838.612027:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787764838.612035:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222059904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764838.612044:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764838.612056:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e23fa expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.612074:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23fa expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.612082:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc81676c00/0x3ec49d1dfa4e2401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e23fa expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.612088:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc81676c00, rc 0) 00000100:00100000:1.0:1787764838.612121:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222059904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.612129:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787764838.612146:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222059904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764838.612160:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc88586600/0x3ec49d1dfa4e23fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2401 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.612187:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc88586600/0x3ec49d1dfa4e23fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2401 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.612238:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222060032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764838.612267:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.612292:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc83ed4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764838.612338:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222060032 00000100:00100000:2.0:1787764838.612342:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222060032 00000100:00100000:2.0:1787764838.612371:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787764838.612379:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222060032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764838.612642:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222060032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787764838.612650:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787764838.612703:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222060032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787764838.612727:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787764838.612732:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88586600/0x3ec49d1dfa4e23fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2401 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.612746:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc88586600/0x3ec49d1dfa4e23fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2401 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.669732:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787764838.782660:0:8464:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc251e9740 20000000:00000080:2.0:1787764838.782676:0:8464:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90dcb3686c00 uarg=0000000000000000 20000000:01000000:2.0:1787764838.782778:0:8464:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787764838.782784:0:8464:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787764838.782788:0:8464:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787764838.783762:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787764838.783857:0:8464:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787764838.786415:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787764838.786471:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787764838.786523:0:8464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787764838.786539:0:8464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787764838.786557:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786616:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940cec00/0x3ec49d1dfa4e21d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786625:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786633:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786643:0:8464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786652:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786690:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786706:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 9 pid: 5798 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.786720:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb75e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1874607222060160:192.168.202.45@tcp:104: 00010000:00010000:3.0:1787764838.786832:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786842:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 18 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.786853:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb74780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1874607222060288:0@lo:104: 00000100:00100000:3.0:1787764838.786904:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764838.786947:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.786956:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 18 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.786964:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1874607222060416:0@lo:104: 00000100:00100000:3.0:1787764838.786990:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787764838.787020:0:8464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940cec00/0x3ec49d1dfa4e21d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.787029:0:8464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940cec00/0x3ec49d1dfa4e21d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 18 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.787038:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1874607222060544:0@lo:104: 00000100:00100000:0.0:1787764838.787043:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787764838.787058:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222060288 00000100:00100000:0.0:1787764838.787065:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222060288 00000100:00100000:0.0:1787764838.787110:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222060416 00000100:00100000:0.0:1787764838.787113:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222060416 00000100:00100000:0.0:1787764838.787133:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787764838.787134:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.787148:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+4:8464:x1874607222060288:12345-0@lo:104: 00000100:00100000:3.0:1787764838.787153:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc88356d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787764838.787160:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.787237:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222060544 00010000:00010000:0.0:1787764838.787242:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787764838.787242:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222060544 00000100:00100000:0.0:1787764838.787251:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+5:8464:x1874607222060288:12345-0@lo:104: Request processed in 107us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.787261:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787764838.787276:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787764838.787286:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787764838.787288:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:8464:x1874607222060416:12345-0@lo:104: 00010000:00010000:1.0:1787764838.787297:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.787305:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+4:8464:x1874607222060544:12345-0@lo:104: 00010000:00010000:0.0:1787764838.787322:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.787343:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787764838.787349:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3db9464f-230d-4339-9306-352e25163ce7+4:8464:x1874607222060416:12345-0@lo:104: Request processed in 67us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764838.787364:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787764838.787383:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787764838.787391:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb76580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+3:8464:x1874607222060544:12345-0@lo:104: Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.787399:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787764838.787424:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787764838.787429:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787438:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940cfc00 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:0.0:1787764838.787443:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787452:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764838.787469:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.787474:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb74780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1874607222060288:0@lo:104: 10000000:01000000:0.0:1787764838.787480:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787764838.787489:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1874607222060416:0@lo:104: 00000100:00100000:3.0:1787764838.787498:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1874607222060544:0@lo:104: 00010000:00010000:0.0:1787764838.787522:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787530:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787764838.787558:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.787573:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222060672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787764838.787614:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc940cfc00/0x3ec49d1dfa4e22a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e22aa expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.787629:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787764838.787631:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787764838.787636:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787643:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130a00 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:0.0:1787764838.787647:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787654:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764838.787661:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764838.787666:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787764838.787674:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222060672 00000100:00100000:1.0:1787764838.787678:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222060672 00010000:00010000:0.0:1787764838.787691:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787701:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764838.787701:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 19 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787720:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787728:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc93130a00/0x3ec49d1dfa4e2241 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e224f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.787730:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787764838.787740:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc99438000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222060672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787764838.787746:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787764838.787751:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764838.787760:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.787760:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 19 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787781:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131800 already unused, calling callback (ffffffffc1c2fc20) 00010000:00010000:1.0:1787764838.787784:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 19 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764838.787787:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787802:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.787805:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc81676400/0x3ec49d1dfa4e22aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e22a3 expref: 19 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787764838.787820:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.787826:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:0.0:1787764838.787828:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787764838.787848:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.787857:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc99438000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3db9464f-230d-4339-9306-352e25163ce7+18:3287:x1874607222060672:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1787764838.787858:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787764838.787868:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787764838.787880:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.787889:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc93131800/0x3ec49d1dfa4e21ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e21d1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.787902:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222060672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787764838.787918:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764838.787922:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764838.787924:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764838.787941:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764838.787951:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764838.787962:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222060800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787764838.787991:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764838.788029:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764838.788037:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222060928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787764838.788061:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764838.788086:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222060800 00000100:00100000:1.0:1787764838.788091:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222060800 00010000:00010000:1.0:1787764838.788109:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 18 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.788287:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222060928 00000100:00100000:0.0:1787764838.788293:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222060928 00000100:00100000:1.0:1787764838.788293:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787764838.788303:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222060800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787764838.788313:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940cec00/0x3ec49d1dfa4e21d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 19 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.788313:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764838.788321:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 19 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.788332:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 19 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764838.788344:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc81677200/0x3ec49d1dfa4e224f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2241 expref: 19 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.788345:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764838.788360:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+18:3288:x1874607222060928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787764838.788360:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764838.788372:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764838.788377:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940cec00/0x3ec49d1dfa4e21d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 18 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764838.788387:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940cec00/0x3ec49d1dfa4e21d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 18 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.788396:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+18:3288:x1874607222060800:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (403us total) trans 0 rc 0/0 00010000:00010000:0.0:1787764838.788400:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940cec00/0x3ec49d1dfa4e21d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e21ca expref: 18 pid: 5797 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764838.788409:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787764838.788415:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787764838.788532:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb75e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8464:1874607222060160:192.168.202.45@tcp:104: 00000100:00100000:0.0:1787764838.788545:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+16:3288:x1874607222060928:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764838.788554:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787764838.788563:0:8464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764838.788612:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222060928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787764838.788626:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222060800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787764838.789431:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764838.789555:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214695680 00000100:00100000:3.0:1787764838.789561:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214695680 00010000:00010000:3.0:1787764838.789662:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 10 pid: 5798 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764838.789745:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 24 00000100:00100000:3.0:1787764838.789755:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc9943ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214695680:12345-192.168.202.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787764838.789766:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764838.789772:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 10 pid: 5798 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789784:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 10 pid: 5798 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789798:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc81676800/0x3ec49d1dfa4e2367 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b255 expref: 10 pid: 5798 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789811:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789818:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789832:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789839:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789846:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789853:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789868:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131a00 already unused, calling callback (ffffffffc15ff530) 00010000:00010000:3.0:1787764838.789873:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789881:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789901:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764838.789911:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787764838.789975:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc9943ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60ac3458-f656-46a2-8942-5ca7481f30b9+9:2364:x1874607214695680:12345-192.168.202.45@tcp:103:ldlm_bl.0 Request processed in 221us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764838.789983:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 24 00010000:00010000:2.0:1787764838.790062:0:8464:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.790073:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764838.790081:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc93131a00/0x3ec49d1dfa4e2408 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764839.694731:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764839.863296:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764839.863353:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214695808 00000100:00100000:1.0:1787764839.863364:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214695808 00000100:00100000:1.0:1787764839.863417:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 166 00000100:00100000:1.0:1787764839.863428:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5597:x1874607214695808:12345-192.168.202.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764839.863443:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764839.863459:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b294 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.863489:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.863516:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.863526:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc85dab400, rc 0) 00000100:00100000:1.0:1787764839.863606:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214695808:12345-192.168.202.45@tcp:101:ll_cfg_requeue.0 Request processed in 156us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764839.863614:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 166 00000100:00100000:0.0:1787764839.864466:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764839.864522:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214695936 00000100:00100000:2.0:1787764839.864527:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214695936 00000100:00100000:2.0:1787764839.864558:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 167 00000100:00100000:2.0:1787764839.864566:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214695936:12345-192.168.202.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.864803:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214695936:12345-192.168.202.45@tcp:501:ll_cfg_requeue.0 Request processed in 238us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.864817:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 167 00000100:00100000:3.0:1787764839.869294:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764839.869352:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214696064 00000100:00100000:1.0:1787764839.869359:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214696064 00000100:00100000:1.0:1787764839.869398:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 168 00000100:00100000:1.0:1787764839.869404:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214696064:12345-192.168.202.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.869607:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214696064:12345-192.168.202.45@tcp:503:ll_cfg_requeue.0 Request processed in 202us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764839.869613:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 168 00000100:00100000:3.0:1787764839.870964:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764839.871018:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214696192 00000100:00100000:2.0:1787764839.871026:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214696192 00000100:00100000:2.0:1787764839.871070:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 169 00000100:00100000:2.0:1787764839.871081:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:6121:x1874607214696192:12345-192.168.202.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787764839.871290:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:6121:x1874607214696192:12345-192.168.202.45@tcp:502:llog_process_th.0 Request processed in 210us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.871298:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 169 00000100:00100000:0.0:1787764839.872382:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764839.872439:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214696320 00000100:00100000:1.0:1787764839.872446:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214696320 00000100:00100000:1.0:1787764839.872485:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 170 00000100:00100000:1.0:1787764839.872495:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:6121:x1874607214696320:12345-192.168.202.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787764839.872701:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:6121:x1874607214696320:12345-192.168.202.45@tcp:502:llog_process_th.0 Request processed in 206us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764839.872709:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 170 10000000:01000000:1.0:1787764839.949688:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787764839.949696:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dcbd590000 from 4 10000000:01000000:1.0:1787764839.949701:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787764839.949745:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.949764:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.949772:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764839.949791:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.949842:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764839.949893:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.949903:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222061056 00000100:00100000:2.0:1787764839.949910:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222061056 00000100:00100000:2.0:1787764839.949961:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787764839.949971:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222061056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764839.949984:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764839.949997:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2416 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.950020:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.950031:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.950039:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cf800, rc 0) 00000100:00100000:2.0:1787764839.950090:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222061056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.950098:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787764839.950128:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764839.950145:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.950156:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764839.950226:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.950251:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764839.950271:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787764839.950295:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222061184 00000100:00100000:0.0:1787764839.950300:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222061184 00000100:00100000:0.0:1787764839.950332:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787764839.950338:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222061184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764839.950561:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222061184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764839.950569:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787764839.950612:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.950643:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.950681:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764839.950708:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd000 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.950718:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222061312 00000100:00100000:2.0:1787764839.950723:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222061312 00000100:00100000:2.0:1787764839.950744:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787764839.950749:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222061312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.950853:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222061312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.950858:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787764839.950874:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.951116:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8532:1874607222061440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764839.951141:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764839.951155:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a7c50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764839.951186:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222061440 00000100:00100000:0.0:1787764839.951190:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222061440 00000100:00100000:0.0:1787764839.951209:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787764839.951214:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:8532:x1874607222061440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787764839.951334:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:8532:x1874607222061440:12345-0@lo:502:llog_process_th.0 Request processed in 119us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764839.951341:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787764839.951350:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8532:1874607222061440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787764839.951371:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787764839.951378:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764839.951380:0:8532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787764839.951388:0:8532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90dcbd590000 00000020:00000080:2.0:1787764839.951389:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787764839.951445:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8532:1874607222061568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764839.951469:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764839.951485:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8b39cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787764839.951521:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222061568 00000100:00100000:1.0:1787764839.951532:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222061568 00000100:00100000:1.0:1787764839.951572:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787764839.951581:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:8532:x1874607222061568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787764839.951727:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:8532:x1874607222061568:12345-0@lo:502:llog_process_th.0 Request processed in 148us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764839.951736:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787764839.951758:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8532:1874607222061568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787764839.951782:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764839.951787:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764839.951789:0:8532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787764839.951794:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787764839.951848:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787764839.951871:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764839.951878:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.951888:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764839.951899:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787764839.951901:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dc89161000 from 4 10000000:01000000:1.0:1787764839.951904:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787764839.951924:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.951933:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.951941:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764839.951954:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.951985:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764839.952014:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222061696 00000100:00100000:1.0:1787764839.952017:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.952019:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222061696 00000100:00100000:2.0:1787764839.952048:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787764839.952054:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222061696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764839.952066:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764839.952075:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2424 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.952089:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.952095:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.952101:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cf000, rc 0) 00000100:00100000:2.0:1787764839.952138:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222061696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764839.952145:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.952147:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:1.0:1787764839.952175:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.952182:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764839.952220:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.952249:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764839.952264:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.952273:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222061824 00000100:00100000:2.0:1787764839.952279:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222061824 00000100:00100000:2.0:1787764839.952306:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787764839.952312:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222061824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.952448:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222061824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.952453:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787764839.952484:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.952513:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764839.952551:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764839.952568:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcbc4fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.952574:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222061952 00000100:00100000:2.0:1787764839.952579:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222061952 00000100:00100000:2.0:1787764839.952639:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787764839.952647:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222061952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.952763:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222061952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764839.952778:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222061952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.952783:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787764839.953005:0:8533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8533:1874607222062080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764839.953036:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764839.953059:0:8533:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8bbe3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787764839.953081:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222062080 00000100:00100000:3.0:1787764839.953086:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222062080 00000100:00100000:3.0:1787764839.953119:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787764839.953129:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:8533:x1874607222062080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764839.953277:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:8533:x1874607222062080:12345-0@lo:502:llog_process_th.0 Request processed in 149us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.953283:0:8533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8533:1874607222062080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764839.953292:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000020:01000000:2.0:1787764839.953304:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787764839.953310:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764839.953311:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787764839.953319:0:8533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90dc89161000 00000020:00000080:2.0:1787764839.953321:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787764839.953370:0:8533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8533:1874607222062208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764839.953404:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764839.953423:0:8533:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc89121600 going to sleep for 11 seconds 00000100:00100000:3.0:1787764839.953448:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222062208 00000100:00100000:3.0:1787764839.953453:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222062208 00000100:00100000:3.0:1787764839.953481:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787764839.953490:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:8533:x1874607222062208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764839.953650:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:8533:x1874607222062208:12345-0@lo:502:llog_process_th.0 Request processed in 162us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764839.953658:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787764839.953662:0:8533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8533:1874607222062208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787764839.953685:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787764839.953690:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787764839.953691:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787764839.953696:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787764839.953748:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787764839.953769:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787764839.953777:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764839.953787:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787764839.953797:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787764839.953799:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dc85d67000 from 4 10000000:01000000:3.0:1787764839.953802:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787764839.953821:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764839.953829:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764839.953838:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764839.953853:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222062336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787764839.953881:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764839.953907:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222062336 00000100:00100000:3.0:1787764839.953911:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a0050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.953912:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222062336 00000100:00100000:2.0:1787764839.953938:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787764839.953943:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222062336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787764839.953949:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764839.953957:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e2432 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.953970:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.953981:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764839.953986:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940ce800, rc 0) 00000100:00100000:2.0:1787764839.954014:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222062336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.954020:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787764839.954053:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222062336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764839.954065:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764839.954080:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764839.954126:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222062464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764839.954152:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764839.954184:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a0050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.954191:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222062464 00000100:00100000:2.0:1787764839.954195:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222062464 00000100:00100000:2.0:1787764839.954221:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787764839.954230:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222062464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.954409:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222062464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.954417:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787764839.954444:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222062464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764839.954477:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222062592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764839.954514:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764839.954530:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a0050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.954537:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222062592 00000100:00100000:2.0:1787764839.954543:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222062592 00000100:00100000:2.0:1787764839.954569:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787764839.954576:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222062592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787764839.954722:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222062592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.954728:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787764839.954748:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222062592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764839.954981:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8535:1874607222062720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764839.955016:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764839.955046:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a005480 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.955057:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222062720 00000100:00100000:2.0:1787764839.955061:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222062720 00000100:00100000:2.0:1787764839.955086:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787764839.955093:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:8535:x1874607222062720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764839.955275:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:8535:x1874607222062720:12345-0@lo:502:llog_process_th.0 Request processed in 182us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764839.955289:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8535:1874607222062720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764839.955291:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000020:01000000:3.0:1787764839.955315:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787764839.955321:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787764839.955323:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787764839.955329:0:8535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90dc85d67000 00000020:00000080:3.0:1787764839.955332:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787764839.955404:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8535:1874607222062848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787764839.955445:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764839.955463:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a005480 going to sleep for 11 seconds 00000100:00100000:2.0:1787764839.955550:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222062848 00000100:00100000:2.0:1787764839.955555:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222062848 00000100:00100000:2.0:1787764839.955607:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787764839.955617:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:8535:x1874607222062848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787764839.955760:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:8535:x1874607222062848:12345-0@lo:502:llog_process_th.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764839.955767:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787764839.955780:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbcb76940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3db9464f-230d-4339-9306-352e25163ce7:8535:1874607222062848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787764839.955800:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787764839.955805:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787764839.955806:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787764839.955808:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787764839.955855:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787764839.955876:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764839.955884:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764839.955892:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764840.397953:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222063232:0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.398016:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764840.398086:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764840.398092:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222063360:0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.398120:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764840.398256:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222062976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764840.398300:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764840.398332:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222063488:0@lo:400:kworker.0 00000100:00100000:3.0:1787764840.398353:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764840.398383:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787764840.398390:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222063104:0@lo:400:kworker.0 00000100:00100000:2.0:1787764840.398399:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222063232 00000100:00100000:2.0:1787764840.398406:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222063232 00000100:00100000:3.0:1787764840.398415:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764840.398437:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222063616:0@lo:400:kworker.0 00000100:00100000:2.0:1787764840.398453:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222063488 00000100:00100000:2.0:1787764840.398456:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222063488 00000100:00100000:2.0:1787764840.398469:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222063104 00000100:00100000:2.0:1787764840.398472:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222063104 00000100:00100000:3.0:1787764840.398475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764840.398485:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787764840.398493:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222063232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764840.398514:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787764840.398525:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222063488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764840.398539:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222063232:12345-0@lo:400:kworker.0 Request processed in 47us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764840.398544:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787764840.398558:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787764840.398563:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222063104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764840.398603:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222063488:12345-0@lo:400:kworker.0 Request processed in 60us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764840.398610:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222063104:12345-0@lo:400:kworker.0 Request processed in 46us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764840.398616:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787764840.398627:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787764840.398659:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222063232:0@lo:400:kworker.0 00000100:00100000:1.0:1787764840.398674:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222063360 00000100:00100000:1.0:1787764840.398680:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222063360 00000100:00080000:2.0:1787764840.398699:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787764840.398710:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764840.398714:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222063616 00000100:00100000:1.0:1787764840.398719:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222063616 00000100:00100000:2.0:1787764840.398742:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787764840.398751:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222063360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764840.398757:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787764840.398776:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222063616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764840.398786:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222063360:12345-0@lo:400:kworker.0 Request processed in 37us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764840.398791:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787764840.398817:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996fc780 x1874607222063360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764840.398823:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222063616:12345-0@lo:400:kworker.0 Request processed in 48us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764840.398831:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222063360:0@lo:400:kworker.0 00000100:00100000:1.0:1787764840.398836:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787764840.398853:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222063104:0@lo:400:kworker.0 00010000:00080000:2.0:1787764840.398862:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996ff480 x1874607222063616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787764840.398865:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787764840.398868:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787764840.398876:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222063616:0@lo:400:kworker.0 00000100:00100000:2.0:1787764840.398884:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222063488:0@lo:400:kworker.0 00000100:00100000:0.0:1787764840.398947:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222062976 00000100:00100000:0.0:1787764840.398951:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222062976 00000100:00100000:0.0:1787764840.398994:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787764840.399003:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222062976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764840.399029:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764840.399066:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222062976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764840.399073:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787764840.399099:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd757480 x1874607222062976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764840.399109:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222062976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787764840.717738:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764841.741774:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764841.911708:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764841.911759:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764841.911802:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214696576 00000100:00100000:3.0:1787764841.911813:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764841.911819:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214696576 00000100:00100000:3.0:1787764841.911865:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764841.911874:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214696448 00000100:00100000:0.0:1787764841.911880:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214696448 00000100:00100000:3.0:1787764841.911913:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214696832 00000100:00100000:3.0:1787764841.911922:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214696832 00000100:00100000:2.0:1787764841.911926:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 21 00000100:00100000:0.0:1787764841.911936:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 186 00000100:00100000:2.0:1787764841.911949:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214696576:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764841.911956:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214696448:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764841.912005:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214696704 00000100:00100000:3.0:1787764841.912011:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214696704 00000100:00100000:1.0:1787764841.912023:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 9 00000100:00100000:1.0:1787764841.912042:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2367:x1874607214696832:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764841.912054:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214696448:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764841.912054:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214696576:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 107us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764841.912057:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 10 00000100:00100000:0.0:1787764841.912074:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 186 00000100:00100000:3.0:1787764841.912091:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2367:x1874607214696704:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764841.912092:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 21 00000100:00100000:1.0:1787764841.912119:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2367:x1874607214696832:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764841.912129:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 9 00000100:00100000:3.0:1787764841.912158:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2367:x1874607214696704:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 70us (275us total) trans 0 rc 0/0 00000100:00080000:2.0:1787764841.912160:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787764841.912176:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764841.912176:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 10 00000100:00080000:2.0:1787764841.912183:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764842.446262:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787764842.446299:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222063744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764842.446400:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764842.446621:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222063744 00000100:00100000:1.0:1787764842.446631:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222063744 00000100:00080000:2.0:1787764842.446697:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764842.446897:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787764842.446910:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222063744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764842.446959:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764842.447029:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222063744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764842.447049:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787764842.447108:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc99438f00 x1874607222063744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764842.447133:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222063744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764842.765816:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764843.789915:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764844.813731:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787764844.991452:0:8763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787764845.519499:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222063872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764845.519633:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222064000:0@lo:400:kworker.0 00000100:00100000:3.0:1787764845.519725:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764845.519857:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764845.519874:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222064000 00000100:00100000:2.0:1787764845.519882:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222064000 00000100:00100000:0.0:1787764845.519891:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222063872 00000100:00100000:0.0:1787764845.519894:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222063872 00000100:00100000:0.0:1787764845.519935:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787764845.519935:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787764845.519945:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222063872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764845.519945:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222064000:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787764845.519987:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764845.520005:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222064000:12345-0@lo:400:kworker.0 Request processed in 62us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764845.520013:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787764845.520019:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222063872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764845.520036:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787764845.520053:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787764845.520062:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222064000:0@lo:400:kworker.0 00010000:00080000:0.0:1787764845.520080:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996fde00 x1874607222063872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764845.520100:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222063872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764845.522397:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222064128:0@lo:400:kworker.0 00000100:00100000:2.0:1787764845.522431:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222064512:0@lo:400:kworker.0 00000100:00100000:1.0:1787764845.522472:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764845.522505:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd756580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222064256:0@lo:400:kworker.0 00000100:00100000:2.0:1787764845.522537:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764845.522552:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222064128 00000100:00100000:0.0:1787764845.522559:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222064384:0@lo:400:kworker.0 00000100:00100000:1.0:1787764845.522561:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222064128 00000100:00100000:2.0:1787764845.522576:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764845.522619:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764845.522636:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222064256 00000100:00100000:1.0:1787764845.522638:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222064512 00000100:00100000:2.0:1787764845.522640:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222064256 00000100:00100000:1.0:1787764845.522644:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222064512 00000100:00100000:0.0:1787764845.522654:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222064384 00000100:00100000:0.0:1787764845.522659:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222064384 00000100:00100000:1.0:1787764845.522695:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787764845.522703:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787764845.522706:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc9943a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222064128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764845.522718:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222064384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764845.522778:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc9943a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222064128:12345-0@lo:400:kworker.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764845.522785:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222064384:12345-0@lo:400:kworker.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764845.522794:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787764845.522826:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787764845.522831:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787764845.522861:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7552c0 x1874607222064384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764845.522866:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787764845.522874:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787764845.522876:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222064256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764845.522883:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222064384:0@lo:400:kworker.0 00000100:00100000:1.0:1787764845.522899:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787764845.522909:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd755680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222064512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764845.522918:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222064256:12345-0@lo:400:kworker.0 Request processed in 45us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764845.522933:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764845.522935:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222064128:0@lo:400:kworker.0 00000100:00100000:2.0:1787764845.522962:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd756580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222064256:0@lo:400:kworker.0 00000100:00100000:0.0:1787764845.522966:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222064512:0@lo:400:kworker.0 00000100:00100000:1.0:1787764845.522966:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd755680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222064512:12345-0@lo:400:kworker.0 Request processed in 57us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764845.522980:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787764845.838535:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764846.861780:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764847.031641:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764847.031688:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764847.031899:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214697088 00000100:00100000:0.0:1787764847.031912:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214697088 00000100:00100000:0.0:1787764847.032006:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 25 00000100:00080000:2.0:1787764847.032026:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764847.032037:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214697088:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764847.032168:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214697344 00000100:00100000:1.0:1787764847.032174:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214697344 00000100:00100000:1.0:1787764847.032223:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 12 00000100:00100000:1.0:1787764847.032232:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214697344:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764847.032307:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214697344:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 76us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764847.032315:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 12 00000100:00100000:0.0:1787764847.032460:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214697088:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 429us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764847.032468:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 25 00000100:00080000:2.0:1787764847.032546:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787764847.033196:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764847.033275:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764847.033393:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214697216 00000100:00100000:2.0:1787764847.033398:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214697216 00000100:00100000:2.0:1787764847.033449:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 13 00000100:00100000:2.0:1787764847.033458:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214697216:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764847.033495:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214697216:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 39us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764847.033502:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 13 00000100:00100000:1.0:1787764847.033652:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214696960 00000100:00100000:1.0:1787764847.033656:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214696960 00000100:00100000:1.0:1787764847.033691:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 188 00000100:00100000:1.0:1787764847.033698:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214696960:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764847.033746:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214696960:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 48us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764847.033753:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 188 00000100:00080000:3.0:1787764847.034432:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764847.565884:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764847.569819:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222064640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764847.569933:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764847.570124:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222064640 00000100:00100000:0.0:1787764847.570136:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222064640 00000100:00100000:0.0:1787764847.570219:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787764847.570231:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd756580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222064640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764847.570283:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787764847.570310:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764847.570377:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd756580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222064640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764847.570387:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787764847.570423:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc99438b40 x1874607222064640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764847.570449:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc99438b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222064640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787764847.885799:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764848.910421:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764849.936670:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764850.637892:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222065024:0@lo:400:kworker.0 00000100:00100000:0.0:1787764850.637963:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764850.638027:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787764850.638035:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222065152:0@lo:400:kworker.0 00000100:00100000:0.0:1787764850.638089:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764850.638129:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222065024 00000100:00100000:0.0:1787764850.638137:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222065024 00000100:00100000:0.0:1787764850.638184:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787764850.638194:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222065024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764850.638248:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222065024:12345-0@lo:400:kworker.0 Request processed in 56us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764850.638256:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787764850.638287:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222065152 00000100:00100000:0.0:1787764850.638292:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222065152 00000100:00100000:0.0:1787764850.638341:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787764850.638347:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222065152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.639745:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222064768:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.639786:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.639827:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222065280:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.639865:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.639887:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787764850.639894:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222064896:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.639914:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.639930:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222065408:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.639954:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.639981:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222065408 00000100:00100000:1.0:1787764850.639986:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222065408 00000100:00100000:1.0:1787764850.640019:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787764850.640027:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc99438f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222065408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.640079:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc99438f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222065408:12345-0@lo:400:kworker.0 Request processed in 53us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764850.640086:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787764850.640125:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb329f840 x1874607222065408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764850.640138:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222065408:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.640173:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787764850.640182:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd754f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222065536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764850.640208:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764850.640249:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222065024:0@lo:400:kworker.0 00000100:00100000:1.0:1787764850.640276:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222065280 00000100:00100000:1.0:1787764850.640280:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222065280 00000100:00100000:1.0:1787764850.640302:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222064896 00000100:00100000:1.0:1787764850.640305:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222064896 00000100:00100000:1.0:1787764850.640318:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787764850.640324:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc9943a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222065280:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787764850.640468:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764850.640472:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764850.640476:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764850.640489:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787764850.640497:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc99438b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222064896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764850.640698:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222064768 00000100:00100000:2.0:1787764850.640703:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222064768 00000100:00100000:2.0:1787764850.640734:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787764850.640742:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222064768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764850.642847:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc99438b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222064896:12345-0@lo:400:kworker.0 Request processed in 2347us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764850.642860:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787764850.642925:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222065536 00000100:00100000:3.0:1787764850.642930:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222065536 00000100:00100000:3.0:1787764850.642965:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787764850.642973:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222065536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787764850.643016:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764850.643074:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222065536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764850.643081:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787764850.643131:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222064896:0@lo:400:kworker.0 00000100:00100000:3.0:1787764850.643144:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222065280:0@lo:400:kworker.0 00010000:00080000:3.0:1787764850.643182:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd754f00 x1874607222065536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764850.643198:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd754f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222065536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764850.643316:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222065152:12345-0@lo:400:kworker.0 Request processed in 4967us (5252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764850.643325:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787764850.647255:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc9943a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222065280:12345-0@lo:400:kworker.0 Request processed in 6921us (7380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764850.647269:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787764850.647399:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996fc780 x1874607222065152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764850.647411:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222065152:0@lo:400:kworker.0 00000100:00100000:2.0:1787764850.647547:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222064768:12345-0@lo:400:kworker.0 Request processed in 6806us (7760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764850.647554:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787764850.647618:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222064768:0@lo:400:kworker.0 00010000:00010000:3.0:1787764850.957771:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764851.981770:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764852.153874:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764852.154498:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764852.154553:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214697472 00000100:00100000:3.0:1787764852.154565:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214697600 00000100:00100000:3.0:1787764852.154575:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214697600 00000100:00100000:2.0:1787764852.154576:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214697472 00000100:00100000:3.0:1787764852.154681:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 29 00000100:00100000:3.0:1787764852.154690:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214697600:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764852.154770:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214697600:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764852.154779:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 29 00000100:00100000:2.0:1787764852.154984:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 190 00000100:00100000:2.0:1787764852.154992:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214697472:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764852.155039:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214697472:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 48us (1174us total) trans 0 rc 0/0 00000100:00080000:0.0:1787764852.155089:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764852.155234:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 190 00000100:00100000:0.0:1787764852.156823:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764852.157105:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214697856 00000100:00100000:2.0:1787764852.157111:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214697856 00000100:00100000:2.0:1787764852.157157:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 16 00000100:00100000:2.0:1787764852.157164:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214697856:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764852.157212:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214697856:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 48us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764852.157220:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 16 00000100:00080000:0.0:1787764852.157607:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787764852.158449:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764852.158496:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214697728 00000100:00100000:2.0:1787764852.158501:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214697728 00000100:00100000:2.0:1787764852.158602:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 17 00000100:00100000:2.0:1787764852.158610:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214697728:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764852.158651:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214697728:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764852.158658:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 17 00000100:00080000:0.0:1787764852.159562:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764852.686482:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222065664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764852.686640:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764852.686789:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222065664 00000100:00100000:0.0:1787764852.686800:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222065664 00000100:00100000:0.0:1787764852.686885:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787764852.686895:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222065664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764852.686940:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787764852.689338:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764852.690999:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222065664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4095us (4348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764852.691017:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787764852.694280:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996fc780 x1874607222065664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764852.694451:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222065664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787764853.006214:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764854.031872:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764855.054160:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764855.759970:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222066048:0@lo:400:kworker.0 00000100:00100000:1.0:1787764855.760061:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764855.760118:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787764855.760125:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222066176:0@lo:400:kworker.0 00000100:00100000:1.0:1787764855.760151:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764855.760187:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222066048 00000100:00100000:1.0:1787764855.760194:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222066048 00000100:00100000:1.0:1787764855.760242:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787764855.760252:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222066048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764855.760299:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222066048:12345-0@lo:400:kworker.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764855.760318:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787764855.760344:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222066176 00000100:00100000:1.0:1787764855.760347:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222066176 00000100:00100000:1.0:1787764855.760372:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787764855.760378:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222066176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764855.760407:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222066176:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764855.760412:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787764855.760428:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787764855.760432:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787764855.760462:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e288000 x1874607222066176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764855.760489:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222066176:0@lo:400:kworker.0 00000100:00100000:1.0:1787764855.760503:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222066048:0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.762207:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222065920:0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.762263:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764855.762291:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222066432:0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.762314:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764855.762347:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787764855.762353:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222065792:0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.762391:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764855.762412:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222066304:0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.762433:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764855.762474:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222066432 00000100:00100000:0.0:1787764855.762481:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222066432 00000100:00100000:0.0:1787764855.762523:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787764855.762532:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222066432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.762577:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222066432:12345-0@lo:400:kworker.0 Request processed in 46us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764855.762601:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787764855.763189:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222065792 00000100:00100000:0.0:1787764855.763194:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222065792 00000100:00100000:0.0:1787764855.763226:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787764855.763232:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222065792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.763266:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222065792:12345-0@lo:400:kworker.0 Request processed in 34us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764855.763273:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787764855.763301:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222065920 00000100:00100000:0.0:1787764855.763305:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222065920 00000100:00100000:0.0:1787764855.763325:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222066304 00000100:00100000:0.0:1787764855.763328:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222066304 00000100:00100000:0.0:1787764855.763345:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787764855.763350:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222065920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.763381:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222065920:12345-0@lo:400:kworker.0 Request processed in 30us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764855.763387:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787764855.763399:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787764855.763412:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222066304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.763442:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222066304:12345-0@lo:400:kworker.0 Request processed in 31us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764855.763449:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787764855.763484:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222065792:0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.763497:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222066304:0@lo:400:kworker.0 00000100:00100000:0.0:1787764855.763506:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222065920:0@lo:400:kworker.0 00010000:00080000:0.0:1787764855.763518:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc9197f480 x1874607222066432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764855.763528:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222066432:0@lo:400:kworker.0 00000100:00100000:1.0:1787764855.764299:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787764855.764309:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222066560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764855.764345:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787764855.764375:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787764855.764380:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787764855.765708:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222066560 00000100:00100000:2.0:1787764855.765718:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222066560 00000100:00100000:2.0:1787764855.765766:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787764855.765776:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222066560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764855.765810:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764855.765883:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222066560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764855.765891:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787764855.765931:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cba1c0 x1874607222066560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764855.765950:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222066560:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787764856.078538:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787764856.086230:0:9007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing yml_node 00010000:00010000:0.0:1787764857.103087:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764857.275246:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764857.275289:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764857.275355:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214698112 00000100:00100000:0.0:1787764857.275365:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214698112 00000100:00100000:1.0:1787764857.275430:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214697984 00000100:00100000:1.0:1787764857.275435:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214697984 00000100:00100000:0.0:1787764857.275447:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 33 00000100:00100000:0.0:1787764857.275457:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214698112:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764857.275465:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 192 00000100:00100000:1.0:1787764857.275471:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214697984:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764857.275524:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214697984:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 52us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764857.275531:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 192 00000100:00080000:2.0:1787764857.275544:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764857.275627:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214698112:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 170us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764857.275634:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 33 00000100:00100000:3.0:1787764857.283189:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764857.283235:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764857.283337:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214698240 00000100:00100000:1.0:1787764857.283346:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214698240 00000100:00100000:1.0:1787764857.283410:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214698368 00000100:00100000:1.0:1787764857.283414:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214698368 00000100:00080000:3.0:1787764857.283466:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764857.283470:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764857.283578:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 10 00000100:00100000:0.0:1787764857.283783:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2363:x1874607214698240:12345-192.168.202.45@tcp:9:kworker.0 00000020:00000080:0.0:1787764857.283820:0:6845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ec49d1dfa4e2375 00000100:00080000:0.0:1787764857.283831:0:6845:0:(import.c:65:import_set_state_nolock()) ffff90dcbd714000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787764857.283879:0:6845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787764857.283883:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764857.284304:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+2:2363:x1874607214698240:12345-192.168.202.45@tcp:9:kworker.0 Request processed in 525us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764857.284339:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 11 00000100:00100000:2.0:1787764857.284351:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbcb75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2363:x1874607214698368:12345-192.168.202.45@tcp:9:kworker.0 00000020:00000080:2.0:1787764857.284372:0:6648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ec49d1dfa4e237c 00000100:00080000:2.0:1787764857.284380:0:6648:0:(import.c:65:import_set_state_nolock()) ffff90dcbd597800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787764857.284407:0:6648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787764857.284629:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764857.284652:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbcb75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+2:2363:x1874607214698368:12345-192.168.202.45@tcp:9:kworker.0 Request processed in 303us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764857.284660:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 11 00000100:00100000:0.0:1787764857.285221:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 10 00000100:00100000:2.0:1787764857.807993:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222066688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764857.808081:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764857.808185:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222066688 00000100:00100000:0.0:1787764857.808193:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222066688 00000100:00080000:3.0:1787764857.808246:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764857.808264:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787764857.808280:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222066688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764857.808318:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764857.808622:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222066688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 344us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764857.808630:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787764857.808934:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cb8f00 x1874607222066688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764857.808952:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222066688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764858.126381:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787764858.345692:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5045b8d5-7523-47ae-bf71-6d43e6178916 00000020:00000080:0.0:1787764858.345702:0:6676:0:(genops.c:885:class_export_put()) final put ffff90dcbd710800/5045b8d5-7523-47ae-bf71-6d43e6178916 00000020:00000080:3.0:1787764858.345888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90dcbd710800/5045b8d5-7523-47ae-bf71-6d43e6178916 for lustre-OST0000 00000020:00000080:3.0:1787764858.345945:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90dcbd714000 for lustre-OST0000 00010000:00010000:3.0:1787764859.150490:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764860.174340:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764860.878064:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222067072:0@lo:400:kworker.0 00000100:00100000:0.0:1787764860.878089:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222067200:0@lo:400:kworker.0 00000100:00100000:3.0:1787764860.878166:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222066944:0@lo:400:kworker.0 00000100:00100000:2.0:1787764860.878175:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222066816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764860.883740:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764860.883814:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787764860.883826:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb78383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222067584:0@lo:400:kworker.0 00000100:00100000:0.0:1787764860.883865:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764860.884078:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764860.884122:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222067200 00000100:00100000:1.0:1787764860.884129:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222067200 00000100:00100000:1.0:1787764860.884177:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222067072 00000100:00100000:1.0:1787764860.884191:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222067072 00000100:00100000:1.0:1787764860.884214:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787764860.884221:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222067200:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787764860.885262:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764860.885288:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787764860.885303:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222067072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764860.885376:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222067072:12345-0@lo:400:kworker.0 Request processed in 78us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764860.885384:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787764860.885416:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222067584 00000100:00100000:0.0:1787764860.885431:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222067584 00000100:00100000:0.0:1787764860.885474:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787764860.885480:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222067584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764860.885834:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764860.885875:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222067456:0@lo:400:kworker.0 00000100:00100000:2.0:1787764860.886209:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764860.886238:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222067328:0@lo:400:kworker.0 00000100:00100000:2.0:1787764860.886267:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764860.886311:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222067328 00000100:00100000:2.0:1787764860.886316:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222067328 00000100:00100000:2.0:1787764860.886349:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787764860.886358:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd754f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222067328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764860.891003:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd754f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222067328:12345-0@lo:400:kworker.0 Request processed in 4634us (4722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764860.891020:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787764860.891116:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb329f840 x1874607222067328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764860.891134:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222067328:0@lo:400:kworker.0 00000100:00100000:2.0:1787764860.891198:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222066944 00000100:00100000:2.0:1787764860.891205:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222066944 00000100:00100000:2.0:1787764860.891270:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787764860.891279:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222066944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764860.894454:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222066816 00000100:00100000:3.0:1787764860.894470:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222066816 00000100:00100000:3.0:1787764860.894520:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787764860.894530:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1874607222066816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787764860.894581:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764860.894696:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1874607222066816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (8488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764860.894710:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787764860.894755:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cb83c0 x1874607222066816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764860.894775:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222066816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764860.894820:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764860.894887:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222067456 00000100:00100000:3.0:1787764860.894891:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222067456 00000100:00100000:3.0:1787764860.894932:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787764860.894938:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222067456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764860.894989:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222067456:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764860.894995:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787764860.895017:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787764860.895022:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764860.895025:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787764860.895045:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb78383c0 x1874607222067584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764860.895056:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb78383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222067584:0@lo:400:kworker.0 00000100:00100000:3.0:1787764860.895071:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222067200:0@lo:400:kworker.0 00000100:00100000:3.0:1787764860.895095:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222067456:0@lo:400:kworker.0 00000100:00100000:3.0:1787764860.895150:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222067072:0@lo:400:kworker.0 00000100:00100000:2.0:1787764860.900537:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222066944:12345-0@lo:400:kworker.0 Request processed in 9249us (14692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764860.900554:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787764860.900563:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222066944:0@lo:400:kworker.0 00000100:00100000:1.0:1787764860.900753:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222067200:12345-0@lo:400:kworker.0 Request processed in 16531us (17018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764860.900763:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787764860.908513:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222067584:12345-0@lo:400:kworker.0 Request processed in 23021us (24634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764860.908530:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787764861.201098:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787764861.417085:0:7605:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5045b8d5-7523-47ae-bf71-6d43e6178916 00000020:00000080:0.0:1787764861.417094:0:7605:0:(genops.c:885:class_export_put()) final put ffff90dcbcee0000/5045b8d5-7523-47ae-bf71-6d43e6178916 00000020:00000080:1.0:1787764861.417168:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90dcbcee0000/5045b8d5-7523-47ae-bf71-6d43e6178916 for lustre-OST0001 00000020:00000080:1.0:1787764861.417218:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90dcbd597800 for lustre-OST0001 00010000:00010000:3.0:1787764862.221801:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764862.391512:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764862.391566:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764862.391618:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214698624 00000100:00100000:3.0:1787764862.391627:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214698624 00000100:00100000:3.0:1787764862.391700:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 37 00000100:00100000:3.0:1787764862.391710:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214698624:12345-192.168.202.45@tcp:400:kworker.0 00000100:00080000:2.0:1787764862.395035:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764862.395130:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214698496 00000100:00100000:0.0:1787764862.395138:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214698496 00000100:00100000:0.0:1787764862.395206:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 194 00000100:00100000:0.0:1787764862.395216:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214698496:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764862.395344:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214698624:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 3634us (3777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764862.395353:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 37 00000100:00100000:0.0:1787764862.395552:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214698496:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 337us (4063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764862.395559:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 194 00000100:00100000:3.0:1787764862.926129:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222067712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764862.926197:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764862.926368:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222067712 00000100:00100000:2.0:1787764862.926376:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222067712 00000100:00100000:2.0:1787764862.926441:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787764862.926458:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222067712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787764862.926492:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764862.926537:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222067712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764862.926544:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787764862.926766:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787764862.926794:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cb8b40 x1874607222067712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764862.926824:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222067712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764863.245997:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764864.269988:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764865.294057:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764865.998081:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222067968:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.998184:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764865.998252:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222068480:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.998281:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764865.998316:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787764865.998321:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222067840:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.998352:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764865.998371:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222068352:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.998391:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764865.998456:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222067968 00000100:00100000:0.0:1787764865.998464:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222067968 00000100:00100000:0.0:1787764865.998521:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222068352 00000100:00100000:0.0:1787764865.998524:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222068352 00000100:00100000:0.0:1787764865.998560:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787764865.998570:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222067968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764865.998634:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222068096:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.998651:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222067968:12345-0@lo:400:kworker.0 Request processed in 79us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764865.998676:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787764865.998696:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787764865.998704:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222068352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.998753:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222068352:12345-0@lo:400:kworker.0 Request processed in 43us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764865.998756:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764865.998768:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787764865.998786:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222068096 00000100:00100000:0.0:1787764865.998790:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222068096 00000100:00100000:2.0:1787764865.998812:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787764865.998820:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787764865.998832:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222068224:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.998833:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd757c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222068096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.998904:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd757c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222068096:12345-0@lo:400:kworker.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764865.998906:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764865.998918:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787764865.998983:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222068096:0@lo:400:kworker.0 00000100:00100000:2.0:1787764865.999025:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222068480 00000100:00100000:2.0:1787764865.999031:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222068480 00000100:00100000:2.0:1787764865.999084:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222068224 00000100:00100000:2.0:1787764865.999087:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222068224 00000100:00100000:1.0:1787764865.999114:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222067840 00000100:00100000:1.0:1787764865.999121:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222067840 00000100:00100000:2.0:1787764865.999137:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787764865.999150:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222068480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764865.999163:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787764865.999174:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222067840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764865.999218:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222068480:12345-0@lo:400:kworker.0 Request processed in 67us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764865.999228:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222067840:12345-0@lo:400:kworker.0 Request processed in 55us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764865.999229:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787764865.999245:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787764865.999283:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787764865.999297:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222068224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764865.999354:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222068224:12345-0@lo:400:kworker.0 Request processed in 63us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764865.999360:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787764865.999659:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cb8780 x1874607222068224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764865.999675:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222068224:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.999748:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222068352:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.999765:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222067968:0@lo:400:kworker.0 00010000:00080000:0.0:1787764865.999777:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cbad00 x1874607222068480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764865.999787:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222068480:0@lo:400:kworker.0 00000100:00100000:0.0:1787764865.999817:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222067840:0@lo:400:kworker.0 00000100:00080000:3.0:1787764865.999949:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764865.999955:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764865.999966:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764866.000211:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764866.000222:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222068608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764866.000262:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764866.000330:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222068608 00000100:00100000:0.0:1787764866.000335:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222068608 00000100:00100000:0.0:1787764866.000374:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787764866.000382:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222068608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764866.000416:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764866.000505:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222068608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764866.000512:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787764866.002081:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cb8780 x1874607222068608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764866.002108:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222068608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787764866.317729:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787764866.920396:0:9201:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.118 00010000:00010000:0.0:1787764867.341927:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764867.522865:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764867.524040:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764867.524123:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214698880 00000100:00100000:1.0:1787764867.524134:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214698880 00000100:00100000:1.0:1787764867.524203:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 41 00000100:00100000:1.0:1787764867.524214:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb783b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214698880:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764867.524288:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb783b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214698880:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 77us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764867.524296:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 41 00000100:00100000:2.0:1787764867.524703:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214698752 00000100:00100000:2.0:1787764867.524708:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214698752 00000100:00100000:2.0:1787764867.524739:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 196 00000100:00100000:2.0:1787764867.524746:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214698752:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764867.524773:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214698752:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764867.524779:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 196 00000100:00080000:0.0:1787764867.526122:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764868.045882:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764868.045916:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222068736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764868.045981:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764868.046159:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222068736 00000100:00100000:1.0:1787764868.046167:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222068736 00000100:00100000:1.0:1787764868.046230:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787764868.046240:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd756940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222068736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764868.046273:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764868.046319:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd756940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222068736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764868.046325:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787764868.046364:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cbb480 x1874607222068736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764868.046383:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222068736:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787764868.046788:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787764868.365871:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764869.389734:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787764869.557249:0:9299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.118 00010000:00010000:0.0:1787764870.413781:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787764871.040672:0:9396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.118 00000100:00100000:3.0:1787764871.119016:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222068864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764871.119096:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764871.119139:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222068864 00000100:00100000:0.0:1787764871.119147:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222068864 00000100:00080000:3.0:1787764871.119181:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787764871.119213:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787764871.119225:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222068864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764871.119261:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764871.119312:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222068864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764871.119320:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787764871.119407:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc9197f480 x1874607222068864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764871.119426:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222068864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764871.120218:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222069120:0@lo:400:kworker.0 00000100:00100000:1.0:1787764871.120249:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.120283:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787764871.120290:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222069248:0@lo:400:kworker.0 00000100:00100000:1.0:1787764871.120312:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764871.120422:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222069120 00000100:00100000:0.0:1787764871.120428:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222069120 00000100:00100000:3.0:1787764871.120447:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222069248 00000100:00100000:3.0:1787764871.120452:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222069248 00000100:00100000:0.0:1787764871.120479:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787764871.120486:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787764871.120490:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222069120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.120495:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222069248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.120540:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222069248:12345-0@lo:400:kworker.0 Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.120549:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787764871.120554:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222069120:12345-0@lo:400:kworker.0 Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764871.120565:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787764871.120565:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222069248:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.120580:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb78383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222068992:0@lo:400:kworker.0 00000100:00100000:1.0:1787764871.120606:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222069120:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.120636:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.120663:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222068992 00000100:00100000:1.0:1787764871.120668:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222068992 00000100:00100000:3.0:1787764871.120668:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222069504:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.120694:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764871.120718:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787764871.120719:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787764871.120729:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222069376:0@lo:400:kworker.0 00000100:00100000:0.0:1787764871.120733:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222069504 00000100:00100000:1.0:1787764871.120733:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222068992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764871.120740:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222069504 00000100:00100000:3.0:1787764871.120762:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764871.120775:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787764871.120787:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222069504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764871.120797:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222068992:12345-0@lo:400:kworker.0 Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.120802:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb78383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222068992:0@lo:400:kworker.0 00000100:00100000:1.0:1787764871.120809:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787764871.120832:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222069376 00000100:00100000:3.0:1787764871.120836:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222069376 00000100:00100000:0.0:1787764871.120844:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222069504:12345-0@lo:400:kworker.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764871.120853:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787764871.120891:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787764871.120902:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222069376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764871.120910:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222069504:0@lo:400:kworker.0 00000100:00100000:3.0:1787764871.120957:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222069376:12345-0@lo:400:kworker.0 Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764871.120966:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787764871.120971:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cfc00 x1874607222069376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764871.120982:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222069376:0@lo:400:kworker.0 00000100:00080000:3.0:1787764871.120986:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764871.120992:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787764871.437850:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764872.461796:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764872.631952:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764872.632009:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764872.632073:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214699008 00000100:00100000:0.0:1787764872.632081:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214699008 00000100:00100000:0.0:1787764872.632132:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 198 00000100:00100000:0.0:1787764872.632139:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214699008:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764872.632205:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214699008:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764872.632213:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 198 00000100:00100000:1.0:1787764872.632409:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214699136 00000100:00100000:1.0:1787764872.632424:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214699136 00000100:00100000:1.0:1787764872.632518:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 45 00000100:00100000:1.0:1787764872.632527:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214699136:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764872.632569:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214699136:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 45us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764872.632574:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 45 00000100:00080000:3.0:1787764872.632780:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764873.165805:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222069632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764873.165896:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764873.166972:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222069632 00000100:00100000:0.0:1787764873.166980:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222069632 00000100:00100000:0.0:1787764873.167056:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787764873.167067:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd755a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222069632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764873.167125:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764873.167185:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd755a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222069632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764873.167193:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787764873.167262:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cba580 x1874607222069632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787764873.167268:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764873.167287:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222069632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764873.486710:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764874.510116:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764875.536307:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787764875.777035:0:9444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-compr ============----- Wed Aug 26 13:21:14 EDT 2026 00000100:00100000:0.0:1787764876.238049:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222069760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764876.238122:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764876.238277:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222069760 00000100:00100000:3.0:1787764876.238285:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222069760 00000100:00100000:2.0:1787764876.238304:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd754b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222070272:0@lo:400:kworker.0 00000100:00100000:2.0:1787764876.238336:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764876.238336:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787764876.238345:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222069760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764876.238356:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787764876.238361:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222070144:0@lo:400:kworker.0 00000100:00100000:2.0:1787764876.238386:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787764876.238391:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764876.238411:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222070272 00000100:00100000:2.0:1787764876.238414:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222070272 00000100:00100000:3.0:1787764876.238434:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222069760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764876.238442:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787764876.238443:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787764876.238449:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222070272:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787764876.238461:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764876.238465:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787764876.238480:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222070272:12345-0@lo:400:kworker.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764876.238486:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787764876.238505:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222070144 00010000:00080000:3.0:1787764876.238506:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd754b40 x1874607222070272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764876.238508:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222070144 00000100:00100000:3.0:1787764876.238518:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd754b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222070272:0@lo:400:kworker.0 00010000:00080000:3.0:1787764876.238531:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc883ef0c0 x1874607222069760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764876.238537:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787764876.238542:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222070144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764876.238544:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222069760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764876.238571:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222070144:12345-0@lo:400:kworker.0 Request processed in 29us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764876.238576:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787764876.238580:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd756d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222070144:0@lo:400:kworker.0 00000100:00080000:2.0:1787764876.238612:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764876.238665:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd757840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222069888:0@lo:400:kworker.0 00000100:00100000:0.0:1787764876.238696:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764876.238727:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222070400:0@lo:400:kworker.0 00000100:00100000:0.0:1787764876.238749:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764876.238777:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764876.238782:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222070016:0@lo:400:kworker.0 00000100:00100000:0.0:1787764876.238815:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764876.238952:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222069888 00000100:00100000:2.0:1787764876.238956:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222069888 00000100:00100000:2.0:1787764876.238997:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787764876.239004:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222069888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764876.239043:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222069888:12345-0@lo:400:kworker.0 Request processed in 39us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764876.239049:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787764876.239083:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd757840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222069888:0@lo:400:kworker.0 00000100:00100000:3.0:1787764876.239270:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222070400 00000100:00100000:3.0:1787764876.239274:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222070400 00000100:00100000:3.0:1787764876.239314:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222070016 00000100:00100000:3.0:1787764876.239317:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222070016 00000100:00100000:3.0:1787764876.239339:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787764876.239346:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222070400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764876.239380:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222070400:12345-0@lo:400:kworker.0 Request processed in 35us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764876.239386:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787764876.239398:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787764876.239403:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222070016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764876.239432:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222070016:12345-0@lo:400:kworker.0 Request processed in 28us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764876.239438:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787764876.239568:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764876.239607:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222070016:0@lo:400:kworker.0 00000100:00100000:2.0:1787764876.239618:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222070400:0@lo:400:kworker.0 00010000:00010000:3.0:1787764876.562266:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764877.581763:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764877.753764:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764877.753865:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764877.753902:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214699264 00000100:00100000:1.0:1787764877.754015:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214699264 00000100:00100000:3.0:1787764877.754035:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214699392 00000100:00100000:3.0:1787764877.754040:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214699392 00000100:00100000:1.0:1787764877.754077:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 200 00000100:00100000:1.0:1787764877.754089:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214699264:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764877.754101:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 49 00000100:00100000:3.0:1787764877.754217:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214699392:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764877.754268:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214699392:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 159us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764877.754277:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 49 00000100:00080000:3.0:1787764877.754308:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764877.754549:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214699264:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 461us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764877.754557:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 200 00000100:00100000:0.0:1787764878.288868:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764878.288968:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb329f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222070528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764878.289033:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764878.289140:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222070528 00000100:00100000:1.0:1787764878.289147:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222070528 00000100:00100000:1.0:1787764878.289207:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787764878.289217:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222070528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764878.289249:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764878.289358:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222070528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764878.289367:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787764878.289421:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787764878.289449:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb329f840 x1874607222070528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764878.289469:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb329f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222070528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764878.605915:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764879.629744:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764880.653689:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764881.357952:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787764881.357975:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222070656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764881.358045:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764881.358190:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222070912:0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.358218:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764881.358259:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222071424:0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.358328:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764881.358348:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787764881.358352:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222071040:0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.358365:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764881.358398:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222070912 00000100:00100000:3.0:1787764881.358402:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222070912 00000100:00100000:3.0:1787764881.358451:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222071040 00000100:00100000:3.0:1787764881.358455:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222071040 00000100:00100000:3.0:1787764881.358485:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787764881.358495:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222070912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.358545:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222070912:12345-0@lo:400:kworker.0 Request processed in 51us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764881.358552:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787764881.358570:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787764881.358577:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222071040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.358625:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222071040:12345-0@lo:400:kworker.0 Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764881.358631:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787764881.358650:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222071424 00000100:00100000:3.0:1787764881.358654:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222071424 00000100:00100000:3.0:1787764881.358677:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787764881.358681:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222071424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.358714:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222071424:12345-0@lo:400:kworker.0 Request processed in 34us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764881.358719:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787764881.358734:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764881.358737:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764881.358759:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222071040:0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.358766:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222070912:0@lo:400:kworker.0 00010000:00080000:3.0:1787764881.358772:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc883ec000 x1874607222071424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764881.358779:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222071424:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.358867:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222070784:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.358887:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764881.358900:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607222071296:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.358919:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764881.358934:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787764881.358940:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222071168:0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.358976:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764881.359005:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222071168 00000100:00100000:2.0:1787764881.359009:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222071168 00000100:00100000:2.0:1787764881.359040:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787764881.359047:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222071168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764881.359081:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222071168:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764881.359098:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787764881.359180:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc883ecf00 x1874607222071168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764881.359190:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222071168:0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.359256:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222070784 00000100:00100000:3.0:1787764881.359260:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222070784 00000100:00100000:3.0:1787764881.359381:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787764881.359387:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222070784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.359420:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222070784:12345-0@lo:400:kworker.0 Request processed in 34us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764881.359424:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1787764881.359440:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764881.359444:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222071296 00000100:00100000:3.0:1787764881.359447:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222071296 00000100:00100000:3.0:1787764881.359462:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787764881.359466:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607222071296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764881.359491:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607222071296:12345-0@lo:400:kworker.0 Request processed in 24us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764881.359497:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787764881.359521:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764881.359647:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222070784:0@lo:400:kworker.0 00000100:00100000:1.0:1787764881.359659:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607222071296:0@lo:400:kworker.0 00000100:00100000:0.0:1787764881.359839:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222070656 00000100:00100000:0.0:1787764881.359844:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222070656 00000100:00100000:0.0:1787764881.359875:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787764881.359883:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb329f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222070656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764881.359917:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764881.359960:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb329f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222070656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764881.359967:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787764881.359989:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc883ed2c0 x1874607222070656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764881.360005:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222070656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787764881.682324:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764882.701837:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764882.879808:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764882.879845:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764882.879954:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214699648 00000100:00100000:0.0:1787764882.879964:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214699648 00000100:00100000:0.0:1787764882.880033:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 53 00000100:00100000:0.0:1787764882.880043:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214699648:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764882.880111:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214699648:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764882.880118:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 53 00000100:00080000:3.0:1787764882.881237:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764882.905878:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214699520 00000100:00100000:1.0:1787764882.905893:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214699520 00000100:00100000:1.0:1787764882.906368:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 202 00000100:00100000:1.0:1787764882.906379:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214699520:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764882.906455:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214699520:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 78us (26655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764882.906462:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 202 00000100:00100000:0.0:1787764883.405884:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764883.408332:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222071552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764883.408398:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764883.408560:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222071552 00000100:00100000:3.0:1787764883.408566:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222071552 00000100:00100000:3.0:1787764883.408684:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787764883.408693:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222071552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764883.408725:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764883.408777:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222071552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764883.408784:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787764883.408935:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcaa1c0 x1874607222071552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764883.408954:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222071552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787764883.411095:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787764883.725805:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764884.749930:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764885.773828:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764886.478104:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222072064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764886.478118:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222071808:0@lo:400:kworker.0 00000100:00100000:1.0:1787764886.478182:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764886.478182:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764886.478249:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787764886.478256:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607222071936:0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.478359:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222072064 00000100:00100000:0.0:1787764886.478366:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222072064 00000100:00100000:1.0:1787764886.478862:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607222072320:0@lo:400:kworker.0 00000100:00100000:3.0:1787764886.478873:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764886.478901:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222072448:0@lo:400:kworker.0 00000100:00100000:1.0:1787764886.478902:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764886.478932:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787764886.478939:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764886.478942:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222071680:0@lo:400:kworker.0 00000100:00100000:3.0:1787764886.478982:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222071808 00000100:00100000:1.0:1787764886.478987:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764886.478988:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222071808 00000100:00100000:1.0:1787764886.479020:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222072192:0@lo:400:kworker.0 00000100:00100000:3.0:1787764886.479024:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222071936 00000100:00100000:3.0:1787764886.479028:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222071936 00000100:00100000:3.0:1787764886.479046:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222072320 00000100:00100000:3.0:1787764886.479049:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222072320 00000100:00100000:1.0:1787764886.479050:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764886.479065:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787764886.479087:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222071808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764886.479089:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222071680 00000100:00100000:1.0:1787764886.479096:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222071680 00000100:00100000:1.0:1787764886.479129:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787764886.479137:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222071680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764886.479148:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222071808:12345-0@lo:400:kworker.0 Request processed in 62us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.479157:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787764886.479177:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222071680:12345-0@lo:400:kworker.0 Request processed in 39us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.479178:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787764886.479191:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787764886.479192:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607222071936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764886.479236:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607222071936:12345-0@lo:400:kworker.0 Request processed in 48us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.479243:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787764886.479256:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787764886.479263:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787764886.479265:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607222072320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764886.479278:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222072064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764886.479297:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607222072320:12345-0@lo:400:kworker.0 Request processed in 34us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.479305:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00002000:00000024:0.0:1787764886.479307:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764886.479323:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222072448 00000100:00100000:3.0:1787764886.479327:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222072192 00000100:00100000:2.0:1787764886.479330:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222072448 00000100:00100000:3.0:1787764886.479332:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222072192 00000100:00100000:0.0:1787764886.479363:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607222072064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764886.479374:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787764886.479386:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607222072448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764886.479387:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787764886.479400:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222072192:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787764886.479412:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787764886.479419:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787764886.479422:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787764886.479437:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1874607222072448:12345-0@lo:400:kworker.0 Request processed in 54us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764886.479447:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787764886.479449:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222072192:12345-0@lo:400:kworker.0 Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764886.479457:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787764886.479476:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222071680:0@lo:400:kworker.0 00000100:00100000:3.0:1787764886.479495:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607222071936:0@lo:400:kworker.0 00010000:00080000:1.0:1787764886.479500:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cbb0c0 x1874607222072192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764886.479514:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222072192:0@lo:400:kworker.0 00010000:00080000:3.0:1787764886.479515:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cb8b40 x1874607222072448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764886.479529:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222072448:0@lo:400:kworker.0 00000100:00100000:1.0:1787764886.479532:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222071808:0@lo:400:kworker.0 00010000:00080000:3.0:1787764886.479555:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc883ed680 x1874607222072064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764886.479563:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607222072320:0@lo:400:kworker.0 00000100:00100000:3.0:1787764886.479573:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222072064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764886.479871:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1787764886.797778:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764887.822476:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764888.009468:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764888.009522:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764888.025822:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214699776 00000100:00100000:0.0:1787764888.025838:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214699776 00000100:00100000:0.0:1787764888.025904:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 204 00000100:00100000:0.0:1787764888.025914:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214699776:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764888.025999:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214699776:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 85us (16475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764888.026007:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 204 00000100:00100000:2.0:1787764888.027817:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214699904 00000100:00100000:2.0:1787764888.027827:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214699904 00000100:00100000:2.0:1787764888.027898:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 57 00000100:00100000:2.0:1787764888.027909:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214699904:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764888.027972:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214699904:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 65us (18514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764888.027980:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 57 00000100:00080000:0.0:1787764888.028187:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764888.525890:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222072576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764888.525964:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764888.526133:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222072576 00000100:00100000:1.0:1787764888.526142:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222072576 00000100:00100000:1.0:1787764888.526206:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787764888.526216:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222072576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764888.526259:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787764888.526336:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764888.526919:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222072576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 704us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764888.526928:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787764888.527019:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbca9680 x1874607222072576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764888.527038:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222072576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787764888.845795:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764889.873562:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764890.893795:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764891.597711:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222072704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764891.597770:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764891.597809:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222072704 00000100:00100000:0.0:1787764891.597816:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222072704 00000100:00080000:2.0:1787764891.597844:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787764891.597871:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787764891.597880:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222072704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764891.597913:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764891.597966:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222072704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764891.597973:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787764891.598066:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cc780 x1874607222072704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764891.598084:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222072704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764891.598823:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222073216:0@lo:400:kworker.0 00000100:00100000:3.0:1787764891.598832:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607222073088:0@lo:400:kworker.0 00000100:00100000:2.0:1787764891.598864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764891.598864:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764891.598888:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787764891.598894:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222072960:0@lo:400:kworker.0 00000100:00100000:3.0:1787764891.598915:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764891.598942:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222073088 00000100:00100000:3.0:1787764891.598948:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222073088 00000100:00100000:3.0:1787764891.598980:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222072960 00000100:00100000:3.0:1787764891.598984:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222072960 00000100:00100000:3.0:1787764891.599003:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787764891.599005:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787764891.599009:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd757840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607222073088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764891.599010:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc883ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222072832:0@lo:400:kworker.0 00000100:00100000:2.0:1787764891.599036:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764891.599056:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd757840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607222073088:12345-0@lo:400:kworker.0 Request processed in 47us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764891.599058:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222073344:0@lo:400:kworker.0 00000100:00100000:3.0:1787764891.599069:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787764891.599078:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764891.599081:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222073344 00000100:00100000:3.0:1787764891.599084:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222073344 00000100:00100000:2.0:1787764891.599097:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787764891.599104:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd756d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222072960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764891.599133:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd756d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222072960:12345-0@lo:400:kworker.0 Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764891.599219:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787764891.599226:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222073344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764891.599306:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222073344:12345-0@lo:400:kworker.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764891.599312:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787764891.599343:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222072960:0@lo:400:kworker.0 00000100:00100000:3.0:1787764891.599353:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607222073088:0@lo:400:kworker.0 00000100:00100000:0.0:1787764891.599493:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222073344:0@lo:400:kworker.0 00000100:00080000:3.0:1787764891.599635:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764891.601353:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787764891.601388:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222073216 00000100:00100000:2.0:1787764891.601393:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222073216 00000100:00100000:2.0:1787764891.601451:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787764891.601460:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222073216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764891.601517:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222073216:12345-0@lo:400:kworker.0 Request processed in 59us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764891.601521:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787764891.601979:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764891.602029:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222072832 00000100:00100000:2.0:1787764891.602036:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222072832 00000100:00100000:2.0:1787764891.602065:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787764891.602072:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222072832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764891.602108:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222072832:12345-0@lo:400:kworker.0 Request processed in 36us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764891.602124:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787764891.602170:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc883ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222072832:0@lo:400:kworker.0 00010000:00080000:2.0:1787764891.602184:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7552c0 x1874607222073216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764891.602196:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222073216:0@lo:400:kworker.0 00010000:00010000:3.0:1787764891.917776:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764892.941801:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764893.111760:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764893.111846:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214700160 00000100:00100000:1.0:1787764893.111853:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214700160 00000100:00100000:1.0:1787764893.111927:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 61 00000100:00100000:1.0:1787764893.111938:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd754b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214700160:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764893.112008:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd754b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214700160:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764893.112013:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 61 00000100:00080000:3.0:1787764893.112156:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764893.112189:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764893.112282:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214700032 00000100:00100000:3.0:1787764893.112286:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214700032 00000100:00100000:3.0:1787764893.112315:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 206 00000100:00100000:3.0:1787764893.112320:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214700032:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764893.112349:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214700032:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 30us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764893.112353:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 206 00000100:00100000:2.0:1787764893.646550:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222073472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764893.646620:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764893.646730:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222073472 00000100:00100000:1.0:1787764893.646738:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222073472 00000100:00100000:1.0:1787764893.646846:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787764893.646857:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222073472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764893.646900:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764893.646955:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222073472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764893.646963:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787764893.647013:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cda40 x1874607222073472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764893.647028:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222073472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787764893.650244:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787764893.965826:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764894.993542:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764896.023937:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764896.717997:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764896.718029:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222073600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764896.718123:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764896.718427:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222073984:0@lo:400:kworker.0 00000100:00100000:0.0:1787764896.718461:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764896.718485:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764896.718491:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222074112:0@lo:400:kworker.0 00000100:00100000:3.0:1787764896.718503:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222073856:0@lo:400:kworker.0 00000100:00100000:0.0:1787764896.718520:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764896.718561:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764896.718563:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222074112 00000100:00100000:0.0:1787764896.718571:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222074112 00000100:00100000:3.0:1787764896.718612:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787764896.718620:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222073728:0@lo:400:kworker.0 00000100:00100000:0.0:1787764896.718663:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787764896.718669:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764896.718680:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222074112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764896.718698:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607222074240:0@lo:400:kworker.0 00000100:00100000:3.0:1787764896.718722:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764896.718753:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222073984 00000100:00100000:3.0:1787764896.718757:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222073984 00000100:00100000:0.0:1787764896.718765:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222074112:12345-0@lo:400:kworker.0 Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764896.718776:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787764896.718791:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222073856 00000100:00100000:3.0:1787764896.718795:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222073856 00000100:00100000:0.0:1787764896.718807:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222074240 00000100:00100000:0.0:1787764896.718812:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222074240 00000100:00100000:3.0:1787764896.718816:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787764896.718827:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222073984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764896.718844:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787764896.718853:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222073856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764896.718864:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222073984:12345-0@lo:400:kworker.0 Request processed in 40us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764896.718873:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787764896.718887:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787764896.718895:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607222074240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764896.718902:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222073856:12345-0@lo:400:kworker.0 Request processed in 49us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764896.718910:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787764896.718924:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607222074240:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764896.718930:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787764896.718946:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787764896.718951:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764896.718961:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222073728 00000100:00100000:3.0:1787764896.718964:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222073728 00000100:00100000:3.0:1787764896.718986:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787764896.718991:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222073728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764896.719016:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222073728:12345-0@lo:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764896.719028:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787764896.719141:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222073728:0@lo:400:kworker.0 00000100:00100000:3.0:1787764896.719158:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607222074240:0@lo:400:kworker.0 00000100:00100000:3.0:1787764896.719166:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222073856:0@lo:400:kworker.0 00010000:00080000:3.0:1787764896.719229:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cda40 x1874607222074112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764896.719241:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222074112:0@lo:400:kworker.0 00000100:00100000:3.0:1787764896.719252:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222073984:0@lo:400:kworker.0 00000100:00100000:1.0:1787764896.719804:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222073600 00000100:00100000:1.0:1787764896.719811:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222073600 00000100:00100000:1.0:1787764896.719872:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787764896.719882:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222073600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787764896.720834:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764896.720916:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222073600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1035us (2791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764896.720925:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787764896.721121:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787764896.722062:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcaa940 x1874607222073600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764896.722093:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222073600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787764897.043202:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764898.061794:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764898.233990:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764898.234062:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764898.234284:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214700288 00000100:00100000:2.0:1787764898.234301:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214700288 00000100:00100000:2.0:1787764898.234376:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 208 00000100:00100000:2.0:1787764898.234391:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214700288:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764898.234532:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214700288:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 140us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764898.234545:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 208 00000100:00100000:0.0:1787764898.235396:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214700416 00000100:00100000:0.0:1787764898.235405:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214700416 00000100:00100000:0.0:1787764898.235464:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 65 00000100:00100000:0.0:1787764898.235474:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214700416:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764898.235546:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214700416:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 74us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764898.235554:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 65 00000100:00080000:0.0:1787764898.235578:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764898.804230:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764898.804273:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222074368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764898.804429:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764898.806091:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222074368 00000100:00100000:1.0:1787764898.806446:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222074368 00000100:00100000:1.0:1787764898.806541:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787764898.806555:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222074368:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787764898.806883:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787764898.806979:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764898.807062:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222074368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 510us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764898.807069:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787764898.807241:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cc000 x1874607222074368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764898.807267:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222074368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787764899.085894:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764900.114050:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764901.135356:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764901.838541:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222074752:0@lo:400:kworker.0 00000100:00100000:2.0:1787764901.839786:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222074880:0@lo:400:kworker.0 00000100:00100000:2.0:1787764901.839871:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764901.839958:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787764901.839965:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222075264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764901.839997:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764901.840058:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222074880 00000100:00100000:2.0:1787764901.840067:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222074880 00000100:00100000:2.0:1787764901.840138:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787764901.840150:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222074880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764901.840215:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222074880:12345-0@lo:400:kworker.0 Request processed in 67us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764901.840223:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787764901.840268:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cd2c0 x1874607222074880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764901.840286:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222074880:0@lo:400:kworker.0 00000100:00080000:2.0:1787764901.840321:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764901.840419:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764901.840536:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222074752 00000100:00100000:2.0:1787764901.840540:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222074752 00000100:00100000:2.0:1787764901.841999:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787764901.842014:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222074752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764901.842087:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222074752:12345-0@lo:400:kworker.0 Request processed in 78us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764901.842094:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787764901.842170:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764901.842209:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222074752:0@lo:400:kworker.0 00000100:00100000:3.0:1787764901.847784:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222074496:0@lo:400:kworker.0 00000100:00100000:3.0:1787764901.847921:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764901.848731:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222074624:0@lo:400:kworker.0 00000100:00100000:1.0:1787764901.848790:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764901.848867:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222075136:0@lo:400:kworker.0 00000100:00100000:1.0:1787764901.848899:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764901.848969:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222075264 00000100:00100000:1.0:1787764901.848981:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222075264 00000100:00100000:1.0:1787764901.849065:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787764901.849077:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222075264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787764901.849158:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764901.849220:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222075264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (9221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764901.849229:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787764901.849261:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222075136 00000100:00100000:1.0:1787764901.849264:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222075136 00000100:00100000:1.0:1787764901.849293:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787764901.849300:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222075136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764901.849339:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222075136:12345-0@lo:400:kworker.0 Request processed in 39us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764901.849346:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787764901.849390:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cda40 x1874607222075136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764901.849406:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222075136:0@lo:400:kworker.0 00000100:00080000:1.0:1787764901.849431:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787764901.849454:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcab0c0 x1874607222075264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764901.849472:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222075264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764901.850726:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222075008:0@lo:400:kworker.0 00000100:00100000:3.0:1787764901.850787:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764901.853223:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222074624 00000100:00100000:0.0:1787764901.853243:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222074624 00000100:00100000:0.0:1787764901.853321:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222075008 00000100:00100000:0.0:1787764901.853325:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222075008 00000100:00100000:0.0:1787764901.853377:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787764901.853389:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222074624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764901.853509:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222074624:12345-0@lo:400:kworker.0 Request processed in 122us (4717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764901.853518:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787764901.853538:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787764901.853545:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222075008:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787764901.853801:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764901.853861:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222074624:0@lo:400:kworker.0 00000100:00100000:0.0:1787764901.853961:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222075008:12345-0@lo:400:kworker.0 Request processed in 416us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764901.853969:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787764901.854420:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222075008:0@lo:400:kworker.0 00000100:00100000:2.0:1787764901.854514:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222074496 00000100:00100000:2.0:1787764901.854522:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222074496 00000100:00100000:2.0:1787764901.854650:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787764901.854662:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222074496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764901.854751:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222074496:12345-0@lo:400:kworker.0 Request processed in 92us (6831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764901.854758:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787764901.854849:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222074496:0@lo:400:kworker.0 00010000:00010000:3.0:1787764902.157929:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764903.182031:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764903.351762:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764903.351843:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764903.351922:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214700544 00000100:00100000:1.0:1787764903.351934:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214700544 00000100:00100000:0.0:1787764903.352087:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214700672 00000100:00100000:0.0:1787764903.352092:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214700672 00000100:00100000:1.0:1787764903.352223:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 210 00000100:00100000:1.0:1787764903.352237:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214700544:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764903.352339:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214700544:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 104us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764903.352348:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 210 00000100:00080000:3.0:1787764903.352528:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764903.352630:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 69 00000100:00100000:0.0:1787764903.352640:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc883ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214700672:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764903.352704:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc883ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214700672:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 66us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764903.352722:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 69 00000100:00100000:2.0:1787764903.885827:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787764903.889227:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222075392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764903.889360:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764903.889552:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222075392 00000100:00100000:1.0:1787764903.889561:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222075392 00000100:00100000:1.0:1787764903.889700:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787764903.889712:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222075392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764903.889764:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764903.889833:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222075392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764903.889842:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787764903.889929:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787764903.889981:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cc000 x1874607222075392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764903.893388:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222075392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787764904.205871:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764905.230935:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764906.317477:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764906.957885:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222075520:0@lo:400:kworker.0 00000100:00100000:0.0:1787764906.957965:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764906.958032:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222076032:0@lo:400:kworker.0 00000100:00100000:0.0:1787764906.958061:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764906.958090:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787764906.958097:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222075648:0@lo:400:kworker.0 00000100:00100000:0.0:1787764906.958120:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764906.958134:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222076160:0@lo:400:kworker.0 00000100:00100000:0.0:1787764906.958156:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764906.958181:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222076032 00000100:00100000:0.0:1787764906.958188:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222076032 00000100:00100000:0.0:1787764906.958236:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222075648 00000100:00100000:0.0:1787764906.958240:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222075648 00000100:00100000:0.0:1787764906.958260:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787764906.958268:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222076032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764906.958317:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222076032:12345-0@lo:400:kworker.0 Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764906.958324:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787764906.958342:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787764906.958349:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222075648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764906.958376:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222075648:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764906.958381:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787764906.958420:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222075648:0@lo:400:kworker.0 00000100:00100000:0.0:1787764906.958450:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222076032:0@lo:400:kworker.0 00000100:00100000:1.0:1787764906.958575:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222075904:0@lo:400:kworker.0 00000100:00100000:1.0:1787764906.958625:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764906.958648:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787764906.958654:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222075776:0@lo:400:kworker.0 00000100:00100000:1.0:1787764906.958676:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764906.958701:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222076160 00000100:00100000:1.0:1787764906.958705:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222076160 00000100:00100000:1.0:1787764906.958734:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222075904 00000100:00100000:1.0:1787764906.958737:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222075904 00000100:00100000:1.0:1787764906.958757:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787764906.958781:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222076160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764906.958822:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222076160:12345-0@lo:400:kworker.0 Request processed in 42us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764906.958829:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787764906.958852:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787764906.958859:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222075904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764906.958908:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222075904:12345-0@lo:400:kworker.0 Request processed in 49us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764906.958914:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787764906.958949:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcaa940 x1874607222075904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764906.958960:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222075904:0@lo:400:kworker.0 00000100:00100000:1.0:1787764906.958976:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222075776 00000100:00100000:1.0:1787764906.958979:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222075776 00000100:00100000:1.0:1787764906.959003:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787764906.959010:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222075776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764906.959043:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222075776:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764906.959049:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787764906.959074:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222075776:0@lo:400:kworker.0 00010000:00080000:1.0:1787764906.959096:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbca8b40 x1874607222076160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764906.959105:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222076160:0@lo:400:kworker.0 00000100:00100000:2.0:1787764906.959257:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222075520 00000100:00100000:2.0:1787764906.959262:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222075520 00000100:00100000:2.0:1787764906.959297:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787764906.959305:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222075520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764906.959342:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222075520:12345-0@lo:400:kworker.0 Request processed in 38us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764906.959348:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787764906.959463:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222076288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764906.959497:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787764906.959542:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764906.959546:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764906.959563:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764906.959641:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222075520:0@lo:400:kworker.0 00000100:00100000:0.0:1787764906.960056:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222076288 00000100:00100000:0.0:1787764906.960062:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222076288 00000100:00100000:0.0:1787764906.960089:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787764906.960096:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb78383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222076288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764906.960125:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764906.960209:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb78383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222076288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764906.960215:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787764906.963787:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cc000 x1874607222076288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764906.963816:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222076288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787764907.348962:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787764907.414228:0:10173:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 1081 00010000:00010000:3.0:1787764908.365883:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764908.471447:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764908.471511:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764908.471625:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214700928 00000100:00100000:1.0:1787764908.471633:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214700928 00000100:00100000:1.0:1787764908.471693:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 73 00000100:00100000:1.0:1787764908.471703:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214700928:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764908.471776:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214700928:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 75us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764908.471784:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 73 00000100:00100000:2.0:1787764908.472104:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214700800 00000100:00100000:2.0:1787764908.472109:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214700800 00000100:00100000:2.0:1787764908.472146:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 212 00000100:00100000:2.0:1787764908.472153:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214700800:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764908.472190:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214700800:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 38us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764908.472197:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 212 00000100:00080000:3.0:1787764908.472437:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764909.006026:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222076416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764909.006095:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764909.006278:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222076416 00000100:00100000:0.0:1787764909.006286:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222076416 00000100:00100000:0.0:1787764909.006351:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787764909.006360:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222076416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764909.006395:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764909.006436:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222076416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764909.006443:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787764909.006504:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787764909.006700:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cde00 x1874607222076416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764909.006719:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222076416:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787764909.172903:0:10222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: start setup 13:21:48 (1787764908) === 00010000:00010000:1.0:1787764909.389837:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764910.417959:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764911.438116:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764912.077872:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222076672:0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.077943:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764912.077988:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222077184:0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078011:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764912.078038:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787764912.078043:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222076544:0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078068:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764912.078092:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222077056:0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078112:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764912.078150:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222076672 00000100:00100000:0.0:1787764912.078156:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222076672 00000100:00100000:0.0:1787764912.078193:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222077056 00000100:00100000:0.0:1787764912.078196:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222077056 00000100:00100000:0.0:1787764912.078224:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787764912.078233:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222076672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078276:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222076672:12345-0@lo:400:kworker.0 Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764912.078283:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787764912.078298:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787764912.078304:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222077056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078327:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222077056:12345-0@lo:400:kworker.0 Request processed in 24us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764912.078333:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787764912.078350:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222077184 00000100:00100000:0.0:1787764912.078353:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222077184 00000100:00100000:0.0:1787764912.078380:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787764912.078399:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222077184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078429:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222077184:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764912.078435:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787764912.078453:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222076544 00000100:00100000:0.0:1787764912.078456:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222076544 00000100:00100000:0.0:1787764912.078559:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787764912.078567:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222076544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078630:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222076544:12345-0@lo:400:kworker.0 Request processed in 64us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764912.078636:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1787764912.078663:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787764912.078667:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764912.078696:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222076544:0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078709:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222077056:0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.078717:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222076672:0@lo:400:kworker.0 00010000:00080000:0.0:1787764912.078727:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcab0c0 x1874607222077184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764912.078737:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222077184:0@lo:400:kworker.0 00000100:00100000:3.0:1787764912.078966:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222076800:0@lo:400:kworker.0 00000100:00100000:3.0:1787764912.078996:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764912.079015:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764912.079020:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222076928:0@lo:400:kworker.0 00000100:00100000:3.0:1787764912.079041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764912.079065:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222076928 00000100:00100000:3.0:1787764912.079069:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222076928 00000100:00100000:3.0:1787764912.079103:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787764912.079108:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222076928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764912.079151:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222076928:12345-0@lo:400:kworker.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764912.079156:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787764912.079183:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcaa940 x1874607222076928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764912.079193:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222076928:0@lo:400:kworker.0 00000100:00080000:0.0:1787764912.079305:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764912.079314:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222076800 00000100:00100000:0.0:1787764912.079317:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222076800 00000100:00100000:0.0:1787764912.079342:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787764912.079348:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222076800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.079378:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222076800:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764912.079396:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787764912.079412:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764912.079496:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222077312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764912.079534:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764912.079566:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222076800:0@lo:400:kworker.0 00000100:00100000:0.0:1787764912.079679:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222077312 00000100:00100000:0.0:1787764912.079684:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222077312 00000100:00100000:0.0:1787764912.079718:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787764912.079725:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222077312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764912.079752:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764912.079807:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222077312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764912.079814:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787764912.079835:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cde00 x1874607222077312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764912.079847:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222077312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787764912.463082:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764913.486034:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764913.598054:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764913.598104:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764913.598191:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214701184 00000100:00100000:0.0:1787764913.598199:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214701184 00000100:00100000:0.0:1787764913.598279:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 77 00000100:00100000:0.0:1787764913.598289:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214701184:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764913.598354:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214701184:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 67us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764913.598361:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 77 00000100:00080000:2.0:1787764913.598539:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764913.598963:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214701056 00000100:00100000:1.0:1787764913.598967:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214701056 00000100:00100000:1.0:1787764913.599006:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 214 00000100:00100000:1.0:1787764913.599014:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214701056:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764913.599054:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214701056:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 41us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764913.599061:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 214 00000100:00100000:3.0:1787764914.126798:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764914.126835:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222077440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764914.126924:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764914.127156:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222077440 00000100:00100000:0.0:1787764914.127164:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222077440 00000100:00100000:0.0:1787764914.127225:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787764914.127235:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222077440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764914.127269:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764914.127312:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222077440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764914.127321:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787764914.127922:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cde00 x1874607222077440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764914.127942:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222077440:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787764914.128208:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764914.511196:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764915.536560:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764916.558778:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764917.198357:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222077568:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.198476:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764917.198546:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222078080:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.198575:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764917.198636:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787764917.198650:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222077696:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.198675:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764917.198694:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222078208:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.198721:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764917.198751:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222077824:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.198776:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764917.198796:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764917.198801:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222077952:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.198822:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764917.198856:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222077568 00000100:00100000:3.0:1787764917.198864:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222077568 00000100:00100000:3.0:1787764917.198917:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787764917.198928:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222077568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.198985:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3288:x1874607222077568:12345-0@lo:400:kworker.0 Request processed in 58us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764917.198994:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787764917.199032:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222078080 00000100:00100000:3.0:1787764917.199036:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222078080 00000100:00100000:3.0:1787764917.199074:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222077696 00000100:00100000:3.0:1787764917.199078:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222077696 00000100:00100000:3.0:1787764917.199090:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222077824 00000100:00100000:3.0:1787764917.199092:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222077824 00000100:00100000:3.0:1787764917.199108:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787764917.199114:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222078080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.199149:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222078080:12345-0@lo:400:kworker.0 Request processed in 34us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764917.199169:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787764917.199188:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787764917.199193:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222077696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.199219:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222077696:12345-0@lo:400:kworker.0 Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764917.199225:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787764917.199233:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787764917.199239:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222077824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.199264:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222077824:12345-0@lo:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764917.199270:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787764917.199290:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222078208 00000100:00100000:3.0:1787764917.199293:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222078208 00000100:00100000:3.0:1787764917.199732:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222077952 00000100:00100000:3.0:1787764917.199736:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222077952 00000100:00100000:3.0:1787764917.199757:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787764917.199763:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222078208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.199796:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222078208:12345-0@lo:400:kworker.0 Request processed in 33us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764917.199802:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787764917.199811:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787764917.199816:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222077952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.199838:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222077952:12345-0@lo:400:kworker.0 Request processed in 23us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764917.199844:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787764917.199871:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764917.199876:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764917.199879:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787764917.199926:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb76c43c0 x1874607222077952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764917.199942:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222077952:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.199954:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222077824:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.199986:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222077696:0@lo:400:kworker.0 00010000:00080000:3.0:1787764917.199996:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb76c7840 x1874607222078208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764917.200005:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222078208:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.200014:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3db9464f-230d-4339-9306-352e25163ce7:3288:1874607222077568:0@lo:400:kworker.0 00000100:00100000:3.0:1787764917.200023:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222078080:0@lo:400:kworker.0 00000100:00100000:0.0:1787764917.203297:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787764917.211715:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222078336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764917.211819:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764917.214162:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222078336 00000100:00100000:0.0:1787764917.214180:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222078336 00000100:00100000:1.0:1787764917.217267:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787764917.217288:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222078336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787764917.217342:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764917.217476:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222078336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (5656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764917.217484:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787764917.217569:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cba940 x1874607222078336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764917.217614:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222078336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787764917.585035:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787764917.796445:0:10415:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787764918.609404:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764918.712247:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764918.712302:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764918.712333:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214701312 00000100:00100000:3.0:1787764918.712342:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214701312 00000100:00100000:3.0:1787764918.712392:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 216 00000100:00100000:3.0:1787764918.712401:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214701312:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764918.712508:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214701312:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764918.712515:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 216 00000100:00100000:1.0:1787764918.712938:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214701440 00000100:00100000:1.0:1787764918.712943:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214701440 00000100:00100000:1.0:1787764918.713000:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 81 00000100:00100000:1.0:1787764918.713008:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214701440:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764918.713056:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214701440:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 49us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764918.713064:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 81 00000100:00080000:1.0:1787764918.713082:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764919.245894:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764919.245919:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222078464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764919.246004:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764919.246253:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222078464 00000100:00100000:0.0:1787764919.246267:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222078464 00000100:00100000:0.0:1787764919.246342:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787764919.246352:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222078464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764919.246389:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764919.246478:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222078464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764919.246485:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787764919.246527:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbd7cde00 x1874607222078464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764919.246546:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbd7cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222078464:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787764919.246925:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787764919.629912:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764920.656404:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764921.678964:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764922.317950:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222078976:0@lo:400:kworker.0 00000100:00100000:1.0:1787764922.318024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764922.318083:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787764922.318089:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222078848:0@lo:400:kworker.0 00000100:00100000:1.0:1787764922.318133:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764922.318167:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222078976 00000100:00100000:1.0:1787764922.318174:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222078976 00000100:00100000:1.0:1787764922.318231:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787764922.318242:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222078976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764922.318295:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222078976:12345-0@lo:400:kworker.0 Request processed in 54us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764922.318304:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787764922.318330:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222078848 00000100:00100000:1.0:1787764922.318334:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222078848 00000100:00100000:1.0:1787764922.318362:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787764922.318369:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e288f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222078848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764922.318401:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e288f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222078848:12345-0@lo:400:kworker.0 Request processed in 33us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764922.318408:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787764922.318453:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787764922.318457:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764922.318488:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222078848:0@lo:400:kworker.0 00010000:00080000:1.0:1787764922.318501:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996fcf00 x1874607222078976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764922.318510:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222078976:0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.318622:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222078720:0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.318671:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764922.318689:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222079232:0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.318710:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764922.318735:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787764922.318740:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222078592:0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.318762:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764922.318779:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222079104:0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.318809:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764922.318839:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222079232 00000100:00100000:0.0:1787764922.318844:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222079232 00000100:00100000:0.0:1787764922.318879:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787764922.318887:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222079232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.318926:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222079232:12345-0@lo:400:kworker.0 Request processed in 40us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764922.318948:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787764922.318968:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222078592 00000100:00100000:0.0:1787764922.318971:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222078592 00000100:00100000:0.0:1787764922.318994:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787764922.319001:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222078592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.319033:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222078592:12345-0@lo:400:kworker.0 Request processed in 32us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764922.319039:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787764922.319066:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222078720 00000100:00100000:0.0:1787764922.319069:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222078720 00000100:00100000:0.0:1787764922.319089:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222079104 00000100:00100000:0.0:1787764922.319092:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222079104 00000100:00100000:0.0:1787764922.319112:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787764922.319118:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222078720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.319147:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222078720:12345-0@lo:400:kworker.0 Request processed in 29us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764922.319153:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787764922.319163:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787764922.319170:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222079104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.319197:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222079104:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764922.319203:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787764922.319309:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787764922.319312:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787764922.319343:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222078592:0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.319355:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222079104:0@lo:400:kworker.0 00000100:00100000:0.0:1787764922.319375:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222078720:0@lo:400:kworker.0 00010000:00080000:0.0:1787764922.319385:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996ff480 x1874607222079232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764922.319394:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222079232:0@lo:400:kworker.0 00000100:00100000:2.0:1787764922.320316:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222079360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764922.320361:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764922.320431:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222079360 00000100:00100000:0.0:1787764922.320437:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222079360 00000100:00100000:0.0:1787764922.320481:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787764922.320489:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222079360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764922.320521:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764922.320748:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222079360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764922.320756:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787764922.320872:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc8e288000 x1874607222079360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764922.320889:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc8e288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222079360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787764922.704152:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764923.726532:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764923.832449:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764923.832497:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764923.832677:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214701696 00000100:00100000:1.0:1787764923.832685:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214701696 00000100:00100000:1.0:1787764923.832755:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 85 00000100:00100000:1.0:1787764923.832764:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214701696:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764923.832833:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214701696:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 70us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764923.832841:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 85 00000100:00100000:0.0:1787764923.833148:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214701568 00000100:00100000:0.0:1787764923.833153:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214701568 00000100:00100000:0.0:1787764923.833184:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 218 00000100:00100000:0.0:1787764923.833192:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214701568:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764923.833221:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214701568:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764923.833227:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 218 00000100:00080000:2.0:1787764923.833614:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764924.365829:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222079488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787764924.365913:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764924.366065:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222079488 00000100:00100000:3.0:1787764924.366072:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222079488 00000100:00100000:3.0:1787764924.366140:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787764924.366149:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222079488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764924.366187:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787764924.366276:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764924.367122:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222079488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 971us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764924.367132:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787764924.367204:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbce48b40 x1874607222079488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764924.367225:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222079488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787764924.750542:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764925.781867:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764926.798022:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764927.439046:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222079616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764927.439157:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764927.439249:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222079616 00000100:00100000:2.0:1787764927.439268:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222079616 00000100:00100000:2.0:1787764927.439339:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787764927.439348:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222079616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764927.439405:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764927.439447:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222079616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764927.439454:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787764927.439473:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787764927.439512:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996ff480 x1874607222079616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764927.439530:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222079616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764927.439886:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222080000:0@lo:400:kworker.0 00000100:00100000:3.0:1787764927.439919:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764927.439939:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764927.439944:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222079872:0@lo:400:kworker.0 00000100:00100000:3.0:1787764927.439966:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764927.440867:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222079744:0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.440912:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764927.440950:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222080256:0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.441007:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764927.441034:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787764927.441040:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222080128:0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.441066:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764927.441221:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222080000 00000100:00100000:0.0:1787764927.441228:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222080000 00000100:00100000:0.0:1787764927.441410:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222079872 00000100:00100000:0.0:1787764927.441414:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222079872 00000100:00100000:0.0:1787764927.441445:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222080256 00000100:00100000:0.0:1787764927.441448:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222080256 00000100:00100000:0.0:1787764927.441463:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787764927.441471:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222080000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.441521:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222080000:12345-0@lo:400:kworker.0 Request processed in 50us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764927.441528:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787764927.441544:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787764927.441550:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222079872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.441575:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222079872:12345-0@lo:400:kworker.0 Request processed in 26us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764927.441581:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787764927.441622:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787764927.441629:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222080256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.441661:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222080256:12345-0@lo:400:kworker.0 Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764927.441667:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787764927.441689:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222080128 00000100:00100000:0.0:1787764927.441692:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222080128 00000100:00100000:0.0:1787764927.441726:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787764927.441733:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222080128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.441763:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222080128:12345-0@lo:400:kworker.0 Request processed in 31us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764927.441768:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787764927.441856:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787764927.441861:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764927.441921:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222079872:0@lo:400:kworker.0 00000100:00100000:2.0:1787764927.441933:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222080000:0@lo:400:kworker.0 00000100:00100000:3.0:1787764927.442934:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222079744 00000100:00100000:3.0:1787764927.442942:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222079744 00000100:00100000:3.0:1787764927.442981:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787764927.443005:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222079744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764927.443056:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222079744:12345-0@lo:400:kworker.0 Request processed in 68us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764927.443063:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:0.0:1787764927.443786:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb76c6d00 x1874607222080128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764927.443848:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222080128:0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.443866:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222079744:0@lo:400:kworker.0 00000100:00100000:0.0:1787764927.443878:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222080256:0@lo:400:kworker.0 00010000:00010000:1.0:1787764927.838285:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764928.848709:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764928.963827:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764928.965151:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214701824 00000100:00100000:1.0:1787764928.965163:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214701824 00000100:00100000:0.0:1787764928.965215:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764928.965266:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 220 00000100:00100000:1.0:1787764928.965285:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214701824:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764928.965399:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214701824:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 70us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764928.965408:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 220 00000100:00100000:0.0:1787764928.965696:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214701952 00000100:00100000:0.0:1787764928.965702:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214701952 00000100:00100000:0.0:1787764928.965744:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 89 00000100:00100000:0.0:1787764928.965753:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214701952:12345-192.168.202.45@tcp:400:kworker.0 00000100:00080000:2.0:1787764928.965764:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764928.967792:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214701952:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 2031us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764928.967806:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 89 00000100:00100000:3.0:1787764929.486706:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222080384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764929.486770:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764929.486877:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222080384 00000100:00100000:0.0:1787764929.486884:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222080384 00000100:00100000:0.0:1787764929.486940:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787764929.486949:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222080384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764929.486990:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764929.487031:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222080384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764929.487046:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787764929.487084:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbce48780 x1874607222080384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764929.487102:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222080384:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787764929.487195:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787764929.871063:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764930.894294:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764931.919235:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764932.558891:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222080896:0@lo:400:kworker.0 00000100:00100000:2.0:1787764932.558896:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222080640:0@lo:400:kworker.0 00000100:00100000:3.0:1787764932.558959:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222080512:0@lo:400:kworker.0 00000100:00100000:2.0:1787764932.558991:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764932.558997:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764932.559118:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222080640 00000100:00100000:1.0:1787764932.559125:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222080640 00000100:00100000:3.0:1787764932.559148:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764932.559203:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607222081024:0@lo:400:kworker.0 00000100:00100000:0.0:1787764932.559207:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222080896 00000100:00100000:1.0:1787764932.559215:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787764932.559217:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222080896 00000100:00100000:1.0:1787764932.559231:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222080640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764932.559240:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764932.559281:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787764932.559284:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222080512 00000100:00100000:0.0:1787764932.559292:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222080896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764932.559300:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222080512 00000100:00100000:1.0:1787764932.559312:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222080640:12345-0@lo:400:kworker.0 Request processed in 85us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764932.559349:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787764932.559357:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222080512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764932.559370:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222080896:12345-0@lo:400:kworker.0 Request processed in 81us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764932.559378:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787764932.559401:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222080512:12345-0@lo:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764932.559408:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00080000:0.0:1787764932.559427:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcab0c0 x1874607222080896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787764932.559435:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764932.559442:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222080896:0@lo:400:kworker.0 00000100:00100000:3.0:1787764932.559447:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222081024 00000100:00100000:3.0:1787764932.559450:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222081024 00000100:00100000:0.0:1787764932.559486:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607222080768:0@lo:400:kworker.0 00000100:00100000:3.0:1787764932.559496:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787764932.559503:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607222081024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764932.559523:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764932.559532:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1874607222081024:12345-0@lo:400:kworker.0 Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764932.559536:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222081280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764932.559539:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787764932.559549:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222080768 00000100:00100000:3.0:1787764932.559552:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222080768 00000100:00100000:0.0:1787764932.559561:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764932.559581:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787764932.559609:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607222080768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764932.559615:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222081280 00000100:00100000:0.0:1787764932.559619:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222081280 00000100:00100000:3.0:1787764932.559642:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874607222080768:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764932.559646:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787764932.559648:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787764932.559661:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222081280:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787764932.559668:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764932.559671:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764932.559696:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1874607222080768:0@lo:400:kworker.0 00002000:00000024:0.0:1787764932.559697:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764932.559716:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222080512:0@lo:400:kworker.0 00000100:00100000:3.0:1787764932.559726:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1874607222081024:0@lo:400:kworker.0 00000100:00100000:0.0:1787764932.559732:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222081280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764932.559738:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787764932.559749:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc996fcf00 x1874607222081280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764932.559766:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc996fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222081280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764932.560164:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787764932.560235:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222080640:0@lo:400:kworker.0 00000100:00100000:3.0:1787764932.560246:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222081152:0@lo:400:kworker.0 00000100:00100000:3.0:1787764932.560272:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764932.560393:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222081152 00000100:00100000:0.0:1787764932.560398:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222081152 00000100:00100000:0.0:1787764932.560438:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787764932.560446:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222081152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764932.560488:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222081152:12345-0@lo:400:kworker.0 Request processed in 43us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764932.560496:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787764932.560635:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb76c6d00 x1874607222081152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764932.560643:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222081152:0@lo:400:kworker.0 00010000:00010000:1.0:1787764932.941848:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764933.966799:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764934.074799:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764934.074861:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764934.074967:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214702208 00000100:00100000:3.0:1787764934.074980:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214702208 00000100:00100000:3.0:1787764934.075077:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 93 00000100:00100000:3.0:1787764934.075093:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214702208:12345-192.168.202.45@tcp:400:kworker.0 00000100:00080000:1.0:1787764934.075234:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764934.075424:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214702208:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 334us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764934.075433:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 93 00000100:00100000:0.0:1787764934.076254:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214702080 00000100:00100000:0.0:1787764934.076264:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214702080 00000100:00100000:0.0:1787764934.076331:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 222 00000100:00100000:0.0:1787764934.076341:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214702080:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764934.076390:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214702080:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 50us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764934.076397:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 222 00000100:00100000:0.0:1787764934.606695:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222081408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764934.606758:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764934.606820:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222081408 00000100:00100000:0.0:1787764934.606826:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222081408 00000100:00100000:0.0:1787764934.608012:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787764934.608026:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222081408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764934.608064:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764934.608135:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222081408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764934.608143:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787764934.608200:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbce4a580 x1874607222081408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764934.608219:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222081408:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787764934.609858:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787764934.989817:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764936.016760:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764937.037818:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764937.677949:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764937.679448:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764937.679469:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbceb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222081920:0@lo:400:kworker.0 00000100:00100000:3.0:1787764937.679534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764937.679609:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222081664:0@lo:400:kworker.0 00000100:00100000:3.0:1787764937.679635:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764937.679655:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787764937.679660:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222081792:0@lo:400:kworker.0 00000100:00100000:3.0:1787764937.679681:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764937.679713:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222081664 00000100:00100000:3.0:1787764937.679720:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222081664 00000100:00100000:3.0:1787764937.679758:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222081792 00000100:00100000:3.0:1787764937.679762:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222081792 00000100:00100000:3.0:1787764937.679788:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787764937.679797:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222081664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764937.679846:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1874607222081664:12345-0@lo:400:kworker.0 Request processed in 49us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764937.679854:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787764937.679870:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787764937.679876:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222081792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764937.679903:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222081792:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764937.679909:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1787764937.679925:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764937.679955:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222081792:0@lo:400:kworker.0 00000100:00100000:3.0:1787764937.679966:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1874607222081664:0@lo:400:kworker.0 00000100:00100000:3.0:1787764937.680004:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222081920 00000100:00100000:3.0:1787764937.680008:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222081920 00000100:00100000:3.0:1787764937.680037:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787764937.680044:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222081920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764937.680087:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222081920:12345-0@lo:400:kworker.0 Request processed in 43us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764937.680094:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787764937.680107:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787764937.680127:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbceb2d00 x1874607222081920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764937.680137:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbceb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222081920:0@lo:400:kworker.0 00000100:00100000:0.0:1787764937.683027:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222081536:0@lo:400:kworker.0 00000100:00100000:0.0:1787764937.683087:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764937.683132:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787764937.683140:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222082048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764937.683168:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764937.683204:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222081536 00000100:00100000:0.0:1787764937.683210:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222081536 00000100:00100000:0.0:1787764937.683247:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787764937.683256:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222081536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764937.683315:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b341450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222081536:12345-0@lo:400:kworker.0 Request processed in 60us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764937.683322:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787764937.683350:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222082048 00000100:00100000:0.0:1787764937.683354:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222082048 00000100:00100000:0.0:1787764937.683385:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787764937.683391:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222082048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787764937.683420:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764937.683451:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222082048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764937.683467:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787764937.683487:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787764937.683515:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc83e6ed00 x1874607222082048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764937.683534:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222082048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787764937.683545:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222081536:0@lo:400:kworker.0 00000100:00100000:0.0:1787764937.686237:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbceb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222082176:0@lo:400:kworker.0 00000100:00100000:0.0:1787764937.686300:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764937.686380:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222082176 00000100:00100000:2.0:1787764937.686387:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222082176 00000100:00100000:2.0:1787764937.686435:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787764937.686443:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222082176:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787764937.686542:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764937.690042:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1874607222082176:12345-0@lo:400:kworker.0 Request processed in 3592us (3734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764937.690055:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787764937.692362:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbceb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1874607222082176:0@lo:400:kworker.0 00010000:00010000:3.0:1787764938.062293:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764939.085851:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764939.198936:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764939.199046:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764939.199197:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214702464 00000100:00100000:1.0:1787764939.199208:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214702464 00000100:00100000:1.0:1787764939.199305:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 97 00000100:00100000:1.0:1787764939.199316:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214702464:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764939.199395:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214702464:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764939.199413:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 97 00000100:00080000:0.0:1787764939.199639:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764939.200021:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214702336 00000100:00100000:3.0:1787764939.200027:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214702336 00000100:00100000:3.0:1787764939.200098:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 224 00000100:00100000:3.0:1787764939.200106:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214702336:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764939.200152:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214702336:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 47us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764939.200160:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 224 00000100:00100000:1.0:1787764939.725887:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787764939.725910:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222082304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787764939.725980:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764939.726309:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222082304 00000100:00100000:0.0:1787764939.726317:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222082304 00000100:00100000:0.0:1787764939.726382:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787764939.726391:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc996ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222082304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764939.726424:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764939.726466:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc996ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222082304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764939.726473:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787764939.727068:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787764939.727209:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbce48f00 x1874607222082304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764939.727236:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222082304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787764940.110891:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787764940.442053:0:11113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787764941.134362:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764942.157814:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764942.800096:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222082432:0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.800686:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222082560:0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.800732:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764942.800803:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222083072:0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.800858:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764942.800911:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222083072 00000100:00100000:0.0:1787764942.800920:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222083072 00000100:00100000:0.0:1787764942.800986:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787764942.800997:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222083072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.801062:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222083072:12345-0@lo:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764942.801071:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787764942.801123:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc83e6cf00 x1874607222083072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764942.801141:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222083072:0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.801179:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222082560 00000100:00100000:0.0:1787764942.801183:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222082560 00000100:00100000:0.0:1787764942.801476:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787764942.801494:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764942.801530:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222082944:0@lo:400:kworker.0 00000100:00100000:3.0:1787764942.801564:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764942.801629:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222082560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.801679:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222082560:12345-0@lo:400:kworker.0 Request processed in 59us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764942.801686:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787764942.801698:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222082944 00000100:00100000:0.0:1787764942.801702:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222082944 00000100:00100000:0.0:1787764942.801724:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787764942.801730:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222082944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.801765:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222082944:12345-0@lo:400:kworker.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764942.801771:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787764942.801797:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222082560:0@lo:400:kworker.0 00000100:00100000:3.0:1787764942.801957:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222082432 00000100:00100000:3.0:1787764942.801963:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222082432 00000100:00100000:3.0:1787764942.802006:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787764942.802013:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222082432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764942.802056:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222082432:12345-0@lo:400:kworker.0 Request processed in 43us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764942.802062:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787764942.802101:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222082432:0@lo:400:kworker.0 00000100:00100000:3.0:1787764942.802112:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222082944:0@lo:400:kworker.0 00000100:00100000:1.0:1787764942.802902:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222082688:0@lo:400:kworker.0 00000100:00100000:1.0:1787764942.802956:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764942.802985:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222083200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764942.803006:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764942.803030:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787764942.803035:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222082816:0@lo:400:kworker.0 00000100:00100000:1.0:1787764942.803055:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787764942.803075:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787764942.803492:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787764942.803511:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222082816 00000100:00100000:1.0:1787764942.803517:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222082816 00000100:00100000:1.0:1787764942.803570:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787764942.803580:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbe47f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222082816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.803699:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222082688 00000100:00100000:0.0:1787764942.803704:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222082688 00000100:00100000:0.0:1787764942.803734:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787764942.803741:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89156940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222082688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764942.803810:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89156940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222082688:12345-0@lo:400:kworker.0 Request processed in 69us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764942.803819:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1787764942.803876:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787764942.803880:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764942.804030:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222082688:0@lo:400:kworker.0 00000100:00100000:3.0:1787764942.804203:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222083200 00000100:00100000:3.0:1787764942.804209:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222083200 00000100:00100000:1.0:1787764942.804357:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbe47f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222082816:12345-0@lo:400:kworker.0 Request processed in 779us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764942.804366:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787764942.804719:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787764942.804731:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89155e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222083200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787764942.804769:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764942.804811:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89155e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222083200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764942.804819:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787764942.806353:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc83e6cb40 x1874607222082816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764942.806373:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222082816:0@lo:400:kworker.0 00010000:00080000:0.0:1787764942.806389:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc9197f480 x1874607222083200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764942.806407:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc9197f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222083200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787764943.182934:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764944.214460:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764944.312240:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764944.312379:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764944.312489:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214702720 00000100:00100000:3.0:1787764944.312499:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214702720 00000100:00100000:3.0:1787764944.312606:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 101 00000100:00100000:3.0:1787764944.312619:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214702720:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764944.312696:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2364:x1874607214702720:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 79us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764944.312705:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 101 00000100:00080000:2.0:1787764944.313109:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764944.314387:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214702592 00000100:00100000:1.0:1787764944.314528:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214702592 00000100:00100000:1.0:1787764944.314642:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 226 00000100:00100000:1.0:1787764944.314652:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214702592:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764944.314719:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214702592:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 69us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764944.314727:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 226 00000020:00000080:0.0:1787764944.448191:0:11261:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd429bc7a0 20000000:00000080:0.0:1787764944.448264:0:11261:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90dcb76c0800 uarg=0000000000000000 20000000:01000000:0.0:1787764944.448300:0:11261:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787764944.448306:0:11261:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787764944.448311:0:11261:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787764944.449498:0:11262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787764944.449963:0:11261:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787764944.455895:0:11261:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787764944.456150:0:11261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.456409:0:11261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.456417:0:11261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.456425:0:11261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.456431:0:11261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.456437:0:11261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.456474:0:11261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.456486:0:11261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 18 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764944.456497:0:11261:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce48b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11261:1874607222083328:0@lo:104: 00000100:00100000:0.0:1787764944.456562:0:11261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787764944.457867:0:11261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.457879:0:11261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 18 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764944.457889:0:11261:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce4a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11261:1874607222083456:0@lo:104: 00000100:00100000:0.0:1787764944.457925:0:11261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787764944.458008:0:11261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.458017:0:11261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 18 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764944.458025:0:11261:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce48f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11261:1874607222083584:0@lo:104: 00000100:00100000:0.0:1787764944.458048:0:11261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764944.458326:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222083328 00000100:00100000:1.0:1787764944.458332:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222083456 00000100:00100000:2.0:1787764944.458334:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222083328 00000100:00100000:1.0:1787764944.458339:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222083456 00000100:00100000:1.0:1787764944.458382:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222083584 00000100:00100000:1.0:1787764944.458386:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222083584 00000100:00100000:2.0:1787764944.458393:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787764944.458405:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3db9464f-230d-4339-9306-352e25163ce7+5:11261:x1874607222083456:12345-0@lo:104: 00000100:00100000:1.0:1787764944.458409:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787764944.458416:0:11261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.458419:0:8409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.458428:0:11261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 9 pid: 5797 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764944.458435:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+5:11261:x1874607222083328:12345-0@lo:104: 00000100:00100000:0.0:1787764944.458443:0:11261:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcabc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11261:1874607222083712:192.168.202.45@tcp:104: 00010000:00010000:1.0:1787764944.458447:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.458468:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787764944.458481:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3db9464f-230d-4339-9306-352e25163ce7+5:11261:x1874607222083456:12345-0@lo:104: Request processed in 80us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764944.458489:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787764944.458498:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787764944.458505:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3db9464f-230d-4339-9306-352e25163ce7+4:11261:x1874607222083328:12345-0@lo:104: Request processed in 76us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764944.458512:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787764944.458518:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787764944.458522:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc9197f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3db9464f-230d-4339-9306-352e25163ce7+4:11261:x1874607222083584:12345-0@lo:104: 00010000:00010000:2.0:1787764944.458532:0:8409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.458569:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787764944.458572:0:11261:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8a601600 going to sleep for 11 seconds 00000100:00100000:2.0:1787764944.458575:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc9197f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3db9464f-230d-4339-9306-352e25163ce7+3:11261:x1874607222083584:12345-0@lo:104: Request processed in 57us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764944.458580:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787764944.458608:0:11261:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce48b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11261:1874607222083328:0@lo:104: 00010000:00010000:2.0:1787764944.458611:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1787764944.458617:0:11261:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce4a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11261:1874607222083456:0@lo:104: 00010000:00010000:2.0:1787764944.458617:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764944.458623:0:11261:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce48f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11261:1874607222083584:0@lo:104: 00010000:00010000:2.0:1787764944.458625:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85dabc00 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:2.0:1787764944.458628:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.458636:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787764944.458644:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787764944.458650:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787764944.458681:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.458697:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764944.458772:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787764944.458778:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.458786:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130c00 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:1.0:1787764944.458789:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.458807:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787764944.458813:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764944.458819:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787764944.459040:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.459047:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764944.459066:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.459073:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc93130c00/0x3ec49d1dfa4e2432 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e2439 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.459085:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787764944.459088:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.459093:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85dab600 already unused, calling callback (ffffffffc1c2fc20) 10000000:00010000:1.0:1787764944.459096:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.459103:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787764944.459109:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764944.459121:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787764944.459274:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764944.459322:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.459331:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc85dabc00/0x3ec49d1dfa4e2424 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e242b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.459399:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764944.459401:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764944.459403:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764944.459410:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787764944.459422:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbceb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222083840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787764944.459452:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764944.459483:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222083840 00000100:00100000:2.0:1787764944.459488:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222083840 00010000:00010000:2.0:1787764944.459507:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 19 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764944.459530:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787764944.459536:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+19:3287:x1874607222083840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787764944.459545:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764944.459550:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 19 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.459559:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 19 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.459572:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940cf000/0x3ec49d1dfa4e242b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2424 expref: 19 pid: 5797 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.459613:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787764944.459648:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db9464f-230d-4339-9306-352e25163ce7+18:3287:x1874607222083840:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764944.459655:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787764944.459812:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbceb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3db9464f-230d-4339-9306-352e25163ce7:3287:1874607222083840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787764944.460983:0:11261:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcabc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11261:1874607222083712:192.168.202.45@tcp:104: 00010000:00010000:2.0:1787764944.461016:0:11261:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.461411:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.461525:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787764944.461545:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.461553:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.145@tcp lock: ffff90dc85dab600/0x3ec49d1dfa4e2416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ec49d1dfa4e241d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.461568:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764944.461570:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787764944.461571:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764944.461600:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc89154780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222083968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787764944.461639:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764944.461667:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787764944.461689:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc891570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222084096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787764944.461692:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222083968 00000100:00100000:1.0:1787764944.461699:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222083968 00000100:00100000:3.0:1787764944.461724:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787764944.461725:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 18 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764944.461990:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222084096 00000100:00100000:3.0:1787764944.461995:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222084096 00000100:00100000:1.0:1787764944.461998:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787764944.462010:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89156d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222083968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787764944.462016:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 19 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.462024:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764944.462031:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 19 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.462043:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 19 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.462065:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940ce800/0x3ec49d1dfa4e2439 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2432 expref: 19 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764944.462076:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787764944.462109:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89156d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db9464f-230d-4339-9306-352e25163ce7+18:3289:x1874607222083968:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764944.462117:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787764944.462148:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc89154780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222083968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787764944.462332:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787764944.462393:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764944.462756:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214702848 00000100:00100000:0.0:1787764944.462761:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214702848 00010000:00010000:0.0:1787764944.462780:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 10 pid: 5797 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764944.462839:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+17:3286:x1874607222084096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787764944.462844:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 28 00010000:00010000:3.0:1787764944.462853:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787764944.462858:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214702848:12345-192.168.202.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787764944.462862:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 17 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.462870:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764944.462876:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 17 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.462886:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 10 pid: 5797 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764944.462892:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc940cf800/0x3ec49d1dfa4e241d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ec49d1dfa4e2416 expref: 17 pid: 5796 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.462905:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 10 pid: 5797 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764944.462975:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764944.462983:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc85dab400/0x3ec49d1dfa4e240f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b294 expref: 10 pid: 5797 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.462997:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.463006:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764944.463010:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db9464f-230d-4339-9306-352e25163ce7+16:3286:x1874607222084096:12345-0@lo:103:ldlm_bl.0 Request processed in 671us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764944.463024:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787764944.463032:0:8410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.463041:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.463048:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.463055:0:8410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.463062:0:8410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc88587600 already unused, calling callback (ffffffffc15ff530) 00010000:00010000:0.0:1787764944.463066:0:8410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.463074:0:8410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764944.463130:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc891570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222084096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787764944.463266:0:11261:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764944.463275:0:11261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.464296:0:8410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.464307:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90dc88587600/0x3ec49d1dfa4e2440 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764944.464320:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787764944.464374:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:60ac3458-f656-46a2-8942-5ca7481f30b9+9:2365:x1874607214702848:12345-192.168.202.45@tcp:103:ldlm_bl.0 Request processed in 1520us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764944.464381:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 28 00000100:00100000:2.0:1787764944.845922:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787764944.845954:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222084224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764944.846037:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764944.846080:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222084224 00000100:00100000:0.0:1787764944.846089:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222084224 00000100:00100000:0.0:1787764944.846168:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787764944.846172:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787764944.846179:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222084224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764944.846246:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764944.846317:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222084224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764944.846326:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787764944.847321:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbca83c0 x1874607222084224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764944.847347:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222084224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787764945.229810:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764945.728518:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764945.728632:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214702976 00000100:00100000:0.0:1787764945.728642:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214702976 00000100:00100000:0.0:1787764945.728695:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 227 00000100:00100000:0.0:1787764945.728706:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+9:5597:x1874607214702976:12345-192.168.202.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764945.728724:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764945.728744:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc88586c00/0x3ec49d1dfa4e2447 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b29b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764945.728774:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc88586c00/0x3ec49d1dfa4e2447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b29b expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764945.728795:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc88586c00/0x3ec49d1dfa4e2447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b29b expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764945.728805:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc88586c00, rc 0) 00000100:00100000:0.0:1787764945.728871:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214702976:12345-192.168.202.45@tcp:101:ll_cfg_requeue.0 Request processed in 167us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764945.728879:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 227 00000100:00100000:2.0:1787764945.731402:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764945.733350:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214703104 00000100:00100000:0.0:1787764945.733363:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214703104 00000100:00100000:0.0:1787764945.733428:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 228 00000100:00100000:0.0:1787764945.733438:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214703104:12345-192.168.202.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764945.733725:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214703104:12345-192.168.202.45@tcp:501:ll_cfg_requeue.0 Request processed in 287us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764945.733734:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 228 00000100:00100000:2.0:1787764945.743581:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764945.743777:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214703232 00000100:00100000:1.0:1787764945.743787:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214703232 00000100:00100000:1.0:1787764945.743847:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 229 00000100:00100000:1.0:1787764945.743857:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214703232:12345-192.168.202.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764945.744065:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:5597:x1874607214703232:12345-192.168.202.45@tcp:503:ll_cfg_requeue.0 Request processed in 209us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764945.744074:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 229 00010000:00010000:2.0:1787764946.253974:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787764946.448274:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787764946.448287:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dcbd590000 from 7 10000000:01000000:0.0:1787764946.448292:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787764946.448341:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88586400/0x3ec49d1dfa4e244e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.448353:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc88586400/0x3ec49d1dfa4e244e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.448364:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc88586400/0x3ec49d1dfa4e244e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764946.448389:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787764946.448465:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764946.448771:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc8867ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787764946.448791:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222084352 00000100:00100000:0.0:1787764946.448797:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222084352 00000100:00100000:0.0:1787764946.448868:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787764946.448878:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+16:5800:x1874607222084352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764946.448893:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764946.448909:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc88586800/0x3ec49d1dfa4e2455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e244e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.448934:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc88586800/0x3ec49d1dfa4e2455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e244e expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.448946:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc88586800/0x3ec49d1dfa4e2455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e244e expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.448956:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc88586800, rc 0) 00000100:00100000:0.0:1787764946.449016:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222084352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764946.449024:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787764946.449135:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764946.449152:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc88586400/0x3ec49d1dfa4e244e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2455 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764946.449174:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc88586400/0x3ec49d1dfa4e244e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2455 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764946.449248:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764946.449284:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764946.449320:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc88627480 going to sleep for 11 seconds 00000100:00100000:0.0:1787764946.449365:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222084480 00000100:00100000:0.0:1787764946.449375:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222084480 00000100:00100000:0.0:1787764946.449442:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787764946.449450:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222084480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764946.449741:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222084480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764946.449748:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787764946.450037:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764946.450070:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764946.450115:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764946.450242:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc88627480 going to sleep for 11 seconds 00000100:00100000:1.0:1787764946.452654:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222084608 00000100:00100000:1.0:1787764946.452667:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222084608 00000100:00100000:1.0:1787764946.452717:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787764946.452727:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222084608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764946.452992:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222084608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764946.453000:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787764946.453135:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787764946.453973:0:11353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787764946.454211:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787764946.454239:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787764946.454252:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88586400/0x3ec49d1dfa4e244e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2455 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764946.454266:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc88586400/0x3ec49d1dfa4e244e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2455 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787764946.454277:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787764946.454280:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dc89161000 from 7 10000000:01000000:1.0:1787764946.454282:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787764946.454317:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc85daa400/0x3ec49d1dfa4e245c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764946.454326:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc85daa400/0x3ec49d1dfa4e245c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764946.454335:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc85daa400/0x3ec49d1dfa4e245c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764946.454357:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc89154780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787764946.454414:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764946.454459:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90db83526d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764946.454546:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222084736 00000100:00100000:0.0:1787764946.454562:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222084736 00000100:00100000:0.0:1787764946.454614:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787764946.454622:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+17:5800:x1874607222084736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764946.454634:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764946.454646:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc88586200/0x3ec49d1dfa4e2463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e245c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.454667:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc88586200/0x3ec49d1dfa4e2463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e245c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.454677:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc88586200/0x3ec49d1dfa4e2463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e245c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.454686:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc88586200, rc 0) 00000100:00100000:0.0:1787764946.454733:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222084736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764946.454739:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787764946.454905:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc89154780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787764946.454919:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc85daa400/0x3ec49d1dfa4e245c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2463 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764946.454936:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc85daa400/0x3ec49d1dfa4e245c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2463 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764946.454988:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc89154780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764946.455017:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764946.455035:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90db83526d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787764946.455094:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222084864 00000100:00100000:0.0:1787764946.455099:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222084864 00000100:00100000:0.0:1787764946.455134:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787764946.455142:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222084864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764946.455454:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222084864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764946.455461:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787764946.455531:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc89154780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787764946.455560:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc89154780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787764946.455629:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764946.455644:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90db83526d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787764946.455728:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222084992 00000100:00100000:3.0:1787764946.455732:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222084992 00000100:00100000:3.0:1787764946.455754:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787764946.455760:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222084992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787764946.455919:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222084992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764946.455925:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787764946.456021:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc89154780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222084992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787764946.465875:0:11354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787764946.466025:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787764946.466052:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787764946.466064:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc85daa400/0x3ec49d1dfa4e245c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2463 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.466083:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc85daa400/0x3ec49d1dfa4e245c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2463 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787764946.466093:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787764946.466096:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90dc85d67000 from 7 10000000:01000000:0.0:1787764946.466098:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787764946.466133:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e246a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.466141:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e246a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.466152:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e246a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764946.466182:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222085120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787764946.466274:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764946.466379:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222085120 00000100:00100000:3.0:1787764946.466385:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222085120 00000100:00100000:3.0:1787764946.466431:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787764946.466439:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+18:5800:x1874607222085120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787764946.466455:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764946.466476:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90dc93130400/0x3ec49d1dfa4e2471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ec49d1dfa4e246a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764946.466504:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90dc93130400/0x3ec49d1dfa4e2471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e246a expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764946.466517:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90dc93130400/0x3ec49d1dfa4e2471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ec49d1dfa4e246a expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764946.466525:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc93130400, rc 0) 00000100:00100000:0.0:1787764946.466606:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc904780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764946.466631:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222085120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787764946.466646:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e246a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2471 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.466656:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e246a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ec49d1dfa4e2471 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764946.466703:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222085248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764946.466730:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764946.466761:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc904780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764946.466777:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222085248 00000100:00100000:0.0:1787764946.466782:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222085248 00000100:00100000:3.0:1787764946.466838:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+20:5800:x1874607222085120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764946.466847:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787764946.466876:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787764946.466883:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222085248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787764946.468109:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222085248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1222us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764946.468119:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787764946.468274:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222085248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787764946.468318:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222085376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764946.468361:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764946.468387:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dc904780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787764946.468400:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222085376 00000100:00100000:0.0:1787764946.468403:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222085376 00000100:00100000:0.0:1787764946.468427:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787764946.468434:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b307c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222085376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787764946.468575:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b307c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:5800:x1874607222085376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764946.468581:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787764946.468639:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3db9464f-230d-4339-9306-352e25163ce7:5800:1874607222085376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787764946.471780:0:11358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787764946.471993:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787764946.472009:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787764946.472019:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e246a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2471 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764946.472031:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.145@tcp lock: ffff90dc88587600/0x3ec49d1dfa4e246a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ec49d1dfa4e2471 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764947.277788:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764947.917893:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222085504:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.917968:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764947.918021:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222086016:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.918046:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764947.918074:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787764947.918080:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222085888:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.918104:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764947.918131:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222085632:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.918154:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764947.918170:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222086144:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.918205:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764947.918223:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787764947.918245:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222085760:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.918269:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764947.918300:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222086016 00000100:00100000:1.0:1787764947.918317:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222086016 00000100:00100000:1.0:1787764947.918368:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222085632 00000100:00100000:1.0:1787764947.918371:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222085632 00000100:00100000:1.0:1787764947.918385:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222085760 00000100:00100000:1.0:1787764947.918387:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222085760 00000100:00100000:1.0:1787764947.918403:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787764947.918410:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89154780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222086016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.918472:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89154780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222086016:12345-0@lo:400:kworker.0 Request processed in 61us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764947.918478:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787764947.918497:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787764947.918503:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89156580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222085632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.918533:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89156580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222085632:12345-0@lo:400:kworker.0 Request processed in 31us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764947.918538:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787764947.918549:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787764947.918554:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89157c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222085760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.918579:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89157c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222085760:12345-0@lo:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764947.918883:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222085504 00000100:00100000:3.0:1787764947.918888:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222085504 00000100:00100000:3.0:1787764947.918920:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787764947.918926:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222085504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764947.918960:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222085504:12345-0@lo:400:kworker.0 Request processed in 34us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764947.918966:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787764947.919652:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222085888 00000100:00100000:3.0:1787764947.919659:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222085888 00000100:00100000:3.0:1787764947.919793:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222086144 00000100:00100000:3.0:1787764947.919818:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222086144 00000100:00100000:3.0:1787764947.919845:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787764947.919853:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222085888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764947.919895:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222085888:12345-0@lo:400:kworker.0 Request processed in 43us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764947.919903:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787764947.919914:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787764947.919920:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc891552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222086144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764947.919948:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc891552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222086144:12345-0@lo:400:kworker.0 Request processed in 28us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764947.919954:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787764947.920089:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1787764947.920108:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787764947.920112:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787764947.920114:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764947.920155:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222085760:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.920193:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222085632:0@lo:400:kworker.0 00010000:00080000:1.0:1787764947.920208:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc83e6e940 x1874607222086144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764947.920219:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222086144:0@lo:400:kworker.0 00010000:00080000:1.0:1787764947.920258:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc83e6c000 x1874607222085888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764947.920268:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222085888:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.920276:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222085504:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.920286:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222086016:0@lo:400:kworker.0 00000100:00100000:1.0:1787764947.925284:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc891561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222086272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764947.925375:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764947.925427:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222086272 00000100:00100000:1.0:1787764947.925434:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222086272 00000100:00100000:1.0:1787764947.925494:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787764947.925503:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89155680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222086272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787764947.925538:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764947.925611:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89155680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222086272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764947.925619:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787764947.925658:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc891561c0 x1874607222086272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764947.925676:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc891561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222086272:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787764948.111150:0:11458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg245-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787764948.303221:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764949.331073:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764949.461310:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764949.461411:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764949.461503:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214703360 00000100:00100000:2.0:1787764949.461513:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214703360 00000100:00100000:2.0:1787764949.461626:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 240 00000100:00100000:2.0:1787764949.461638:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8b304050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214703360:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764949.461719:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8b304050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214703360:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 82us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764949.461727:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 240 00000100:00100000:3.0:1787764949.461951:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214703488 00000100:00100000:3.0:1787764949.461956:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214703488 00000100:00100000:3.0:1787764949.462009:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 105 00000100:00100000:3.0:1787764949.462017:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214703488:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764949.462058:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2366:x1874607214703488:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 42us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764949.462065:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 105 00000100:00080000:1.0:1787764949.462154:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764949.966128:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787764949.966172:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222086400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764949.966246:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764949.966519:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222086400 00000100:00100000:1.0:1787764949.966535:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222086400 00000100:00080000:3.0:1787764949.966622:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764949.966714:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787764949.966725:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222086400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764949.966760:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764949.966810:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222086400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764949.966818:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787764949.967505:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbca8780 x1874607222086400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764949.967529:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222086400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764950.350144:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764951.375672:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787764952.178976:0:11558:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: finish setup 13:22:30 (1787764950) === 00010000:00010000:2.0:1787764952.402353:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764953.037886:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222086784:0@lo:400:kworker.0 00000100:00100000:2.0:1787764953.037993:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222086912:0@lo:400:kworker.0 00000100:00100000:3.0:1787764953.038057:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222086528:0@lo:400:kworker.0 00000100:00100000:2.0:1787764953.038088:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764953.038186:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764953.038197:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222086912 00000100:00100000:2.0:1787764953.038206:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222086912 00000100:00100000:3.0:1787764953.038214:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222087040:0@lo:400:kworker.0 00000100:00100000:3.0:1787764953.038243:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764953.038276:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222086528 00000100:00100000:3.0:1787764953.038279:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222086528 00000100:00100000:2.0:1787764953.038280:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787764953.038289:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222086912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764953.038304:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787764953.038310:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222086528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764953.038341:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222086912:12345-0@lo:400:kworker.0 Request processed in 53us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764953.038341:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222086528:12345-0@lo:400:kworker.0 Request processed in 31us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764953.038349:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787764953.038349:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:2.0:1787764953.038369:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787764953.038388:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222086528:0@lo:400:kworker.0 00010000:00080000:2.0:1787764953.038389:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcaad00 x1874607222086912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764953.038401:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcaad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787764953.038459:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764953.038488:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787764953.038494:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222086656:0@lo:400:kworker.0 00000100:00100000:0.0:1787764953.038517:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764953.038544:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787764953.038566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764953.038697:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222087040 00000100:00100000:1.0:1787764953.038702:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222087040 00000100:00100000:1.0:1787764953.038733:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222086784 00000100:00100000:1.0:1787764953.038735:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222086784 00000100:00100000:1.0:1787764953.038747:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222086656 00000100:00100000:1.0:1787764953.038749:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222086656 00000100:00100000:1.0:1787764953.038760:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787764953.038766:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222087040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764953.038817:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222087040:12345-0@lo:400:kworker.0 Request processed in 51us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764953.038824:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787764953.038837:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787764953.038843:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222086784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764953.038871:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222086784:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764953.038877:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787764953.038888:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787764953.038894:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222086656:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787764953.039992:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764953.040050:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222086784:0@lo:400:kworker.0 00000100:00100000:0.0:1787764953.040071:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbceb03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222087296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764953.040090:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222087040:0@lo:400:kworker.0 00000100:00100000:2.0:1787764953.040117:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222087168 00000100:00100000:2.0:1787764953.040122:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222087168 00000100:00100000:2.0:1787764953.040171:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787764953.040179:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222087168:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787764953.040288:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787764953.041217:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764953.041381:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222087296 00000100:00100000:3.0:1787764953.041386:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222087296 00000100:00100000:3.0:1787764953.041422:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787764953.041430:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607222087296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787764953.041462:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764953.048221:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1874607222087168:12345-0@lo:400:kworker.0 Request processed in 8033us (9643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764953.048255:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787764953.053610:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcabc00 x1874607222087168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764953.053631:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222087168:0@lo:400:kworker.0 00000100:00100000:1.0:1787764953.053841:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1874607222086656:12345-0@lo:400:kworker.0 Request processed in 14944us (15320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764953.053853:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787764953.054010:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1874607222086656:0@lo:400:kworker.0 00000100:00100000:3.0:1787764953.054241:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222087296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12809us (13024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764953.054253:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787764953.054377:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbceb03c0 x1874607222087296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764953.054396:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbceb03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222087296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787764953.423245:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764954.446949:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764954.552068:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764954.552131:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764954.552171:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214703744 00000100:00100000:2.0:1787764954.552181:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214703744 00000100:00080000:3.0:1787764954.552252:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764954.552277:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 109 00000100:00100000:2.0:1787764954.552287:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214703744:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764954.552365:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214703744:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 80us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764954.552373:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 109 00000100:00100000:0.0:1787764954.552605:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214703616 00000100:00100000:0.0:1787764954.552609:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214703616 00000100:00100000:0.0:1787764954.552643:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 242 00000100:00100000:0.0:1787764954.552650:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214703616:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764954.552682:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2365:x1874607214703616:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 32us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764954.552689:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 242 00000100:00100000:2.0:1787764955.087777:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222087424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787764955.087849:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764955.088003:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222087424 00000100:00100000:0.0:1787764955.088011:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222087424 00000100:00100000:0.0:1787764955.088090:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787764955.088101:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222087424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787764955.088146:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787764955.088197:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222087424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764955.088204:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787764955.088242:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cbad00 x1874607222087424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764955.088261:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222087424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787764955.088425:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787764955.469787:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764956.493868:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764957.517842:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764958.174326:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222087552:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.174402:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764958.174455:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222088064:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.174482:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764958.174509:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787764958.174515:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222087936:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.174540:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764958.174566:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222087680:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.174636:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764958.174660:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbcabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222088192:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.174681:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764958.174697:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787764958.174702:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222087808:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.174721:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764958.174750:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222087552 00000100:00100000:0.0:1787764958.174755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222087552 00000100:00100000:0.0:1787764958.174799:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787764958.174808:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222087552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.174856:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222087552:12345-0@lo:400:kworker.0 Request processed in 50us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764958.174864:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787764958.174895:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222088064 00000100:00100000:0.0:1787764958.174898:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222088064 00000100:00100000:0.0:1787764958.174928:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222087680 00000100:00100000:0.0:1787764958.174931:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222087680 00000100:00100000:0.0:1787764958.174941:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222087808 00000100:00100000:0.0:1787764958.174944:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222087808 00000100:00100000:0.0:1787764958.174958:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787764958.174963:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222088064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.174993:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222088064:12345-0@lo:400:kworker.0 Request processed in 30us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764958.175000:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787764958.175010:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787764958.175015:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222087680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.175042:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222087680:12345-0@lo:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764958.175057:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787764958.175069:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787764958.175074:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222087808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.175125:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222087808:12345-0@lo:400:kworker.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764958.175130:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787764958.175148:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222087936 00000100:00100000:0.0:1787764958.175151:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222087936 00000100:00100000:0.0:1787764958.175173:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222088192 00000100:00100000:0.0:1787764958.175176:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222088192 00000100:00100000:0.0:1787764958.175193:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787764958.175198:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbca8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222087936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.175228:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbca8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222087936:12345-0@lo:400:kworker.0 Request processed in 30us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764958.175234:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787764958.175244:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787764958.175249:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222088192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.175274:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222088192:12345-0@lo:400:kworker.0 Request processed in 25us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764958.175282:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787764958.175319:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cba940 x1874607222087936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764958.175333:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222087936:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.175342:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222087552:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.175352:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222088064:0@lo:400:kworker.0 00000100:00080000:0.0:1787764958.175381:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787764958.175386:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787764958.175388:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764958.175405:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222087808:0@lo:400:kworker.0 00000100:00100000:0.0:1787764958.175413:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222087680:0@lo:400:kworker.0 00010000:00080000:0.0:1787764958.175421:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbbcabc00 x1874607222088192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764958.175429:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbcabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222088192:0@lo:400:kworker.0 00000100:00100000:3.0:1787764958.189499:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbceb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222088320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764958.189579:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764958.190505:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222088320 00000100:00100000:2.0:1787764958.190514:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222088320 00000100:00100000:2.0:1787764958.190570:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787764958.190579:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222088320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764958.190641:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764958.190695:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222088320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764958.190703:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787764958.191014:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbceb3840 x1874607222088320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764958.191033:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbceb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222088320:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787764958.542450:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764959.569945:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764959.672093:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764959.672151:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764959.672185:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214703872 00000100:00100000:3.0:1787764959.672194:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214703872 00000100:00100000:3.0:1787764959.672261:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 244 00000100:00100000:3.0:1787764959.672271:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214703872:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764959.672353:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2367:x1874607214703872:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764959.672360:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 244 00000100:00100000:2.0:1787764959.672886:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214704000 00000100:00100000:2.0:1787764959.672905:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214704000 00000100:00100000:2.0:1787764959.672951:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 113 00000100:00100000:2.0:1787764959.672959:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214704000:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764959.672992:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214704000:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 34us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764959.672998:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 113 00000100:00080000:2.0:1787764959.673015:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764960.207303:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787764960.207326:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222088448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787764960.207404:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764960.215341:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222088448 00000100:00100000:3.0:1787764960.215366:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222088448 00000100:00100000:3.0:1787764960.215539:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787764960.215550:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222088448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764960.215613:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764960.215709:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222088448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (8304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764960.215716:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1787764960.226370:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787764960.226450:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbc8e5e00 x1874607222088448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764960.226477:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222088448:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764960.595991:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764961.613863:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764962.639448:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764963.279138:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222088576:0@lo:400:kworker.0 00000100:00100000:1.0:1787764963.279209:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764963.279262:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222089088:0@lo:400:kworker.0 00000100:00100000:1.0:1787764963.279287:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764963.279307:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787764963.279312:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222088960:0@lo:400:kworker.0 00000100:00100000:1.0:1787764963.279331:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764963.279391:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222088576 00000100:00100000:3.0:1787764963.279398:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222088576 00000100:00100000:3.0:1787764963.279450:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787764963.279459:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222088576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764963.279505:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222088576:12345-0@lo:400:kworker.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764963.279512:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787764963.280126:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222088576:0@lo:400:kworker.0 00000100:00100000:0.0:1787764963.280247:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222088704:0@lo:400:kworker.0 00000100:00100000:0.0:1787764963.280285:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764963.280318:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb76c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222089216:0@lo:400:kworker.0 00000100:00100000:0.0:1787764963.280342:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764963.280424:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222089088 00000100:00100000:3.0:1787764963.280429:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222089088 00000100:00100000:3.0:1787764963.280469:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222088704 00000100:00100000:3.0:1787764963.280471:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222088704 00000100:00100000:3.0:1787764963.280486:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787764963.280492:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89154f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222089088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764963.280531:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89154f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222089088:12345-0@lo:400:kworker.0 Request processed in 39us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764963.280548:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787764963.280559:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787764963.280565:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222088704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787764963.280628:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222088704:12345-0@lo:400:kworker.0 Request processed in 63us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764963.280634:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787764963.282165:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dc83e6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222088832:0@lo:400:kworker.0 00000100:00100000:2.0:1787764963.282222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764963.282274:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222088832 00000100:00100000:2.0:1787764963.282280:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222088832 00000100:00100000:2.0:1787764963.282317:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787764963.282326:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222088832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787764963.282371:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1874607222088832:12345-0@lo:400:kworker.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764963.282378:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787764963.282432:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbceb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222089344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787764963.282460:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764963.282495:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1874607222088832:0@lo:400:kworker.0 00000100:00100000:2.0:1787764963.282646:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222089344 00000100:00100000:2.0:1787764963.282651:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222089344 00000100:00100000:2.0:1787764963.282680:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787764963.282688:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222089344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764963.282717:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764963.282752:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222089344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764963.282774:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787764963.282807:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbceb0b40 x1874607222089344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764963.282822:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbceb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222089344:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787764963.282848:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787764963.282852:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787764963.282881:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222089088:0@lo:400:kworker.0 00000100:00100000:0.0:1787764963.288511:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222088704:0@lo:400:kworker.0 00000100:00100000:1.0:1787764963.291064:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222088960 00000100:00100000:1.0:1787764963.291077:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222088960 00000100:00100000:1.0:1787764963.294932:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222089216 00000100:00100000:1.0:1787764963.294945:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222089216 00000100:00100000:1.0:1787764963.295006:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787764963.295016:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc891543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222088960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764963.295128:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc891543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222088960:12345-0@lo:400:kworker.0 Request processed in 114us (15795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764963.295135:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787764963.295152:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787764963.295159:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222089216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764963.295197:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222089216:12345-0@lo:400:kworker.0 Request processed in 39us (14854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764963.295203:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787764963.295266:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dc83e6c000 x1874607222088960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764963.295283:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dc83e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222088960:0@lo:400:kworker.0 00010000:00080000:1.0:1787764963.295344:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcb76c6940 x1874607222089216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764963.295354:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb76c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222089216:0@lo:400:kworker.0 00000100:00080000:2.0:1787764963.300858:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764963.662682:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764964.686312:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764964.796519:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764964.796622:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764964.796726:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214704256 00000100:00100000:2.0:1787764964.796736:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214704256 00000100:00100000:2.0:1787764964.796809:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 117 00000100:00100000:2.0:1787764964.796819:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214704256:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764964.796886:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214704256:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 69us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764964.796894:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 117 00000100:00100000:1.0:1787764964.797053:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214704128 00000100:00100000:1.0:1787764964.797058:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214704128 00000100:00100000:1.0:1787764964.797094:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 246 00000100:00100000:1.0:1787764964.797101:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214704128:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:1.0:1787764964.797134:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214704128:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 34us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764964.797140:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 246 00000100:00080000:3.0:1787764964.797409:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764965.326055:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787764965.326076:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222089472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787764965.326145:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787764965.326334:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222089472 00000100:00100000:3.0:1787764965.326342:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222089472 00000100:00100000:3.0:1787764965.326415:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787764965.326424:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222089472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787764965.326458:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787764965.326514:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222089472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764965.326521:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787764965.326600:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787764965.328299:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbc8e6d00 x1874607222089472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787764965.328321:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222089472:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764965.709864:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764966.735728:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764967.757864:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764968.397863:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbceb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222089600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787764968.397931:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764968.398340:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222089984:0@lo:400:kworker.0 00000100:00100000:0.0:1787764968.398368:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764968.398385:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787764968.398390:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222090112:0@lo:400:kworker.0 00000100:00100000:0.0:1787764968.398409:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764968.398481:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222090112 00000100:00100000:1.0:1787764968.398487:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222090112 00000100:00100000:1.0:1787764968.398548:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787764968.398557:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222090112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.398640:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1874607222090112:12345-0@lo:400:kworker.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764968.398648:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787764968.398700:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbc8e7c00 x1874607222090112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764968.398714:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1874607222090112:0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.398740:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222089728:0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.398766:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764968.398785:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222090240:0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.398802:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764968.398815:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787764968.398819:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222089856:0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.398835:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764968.398856:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222089984 00000100:00100000:1.0:1787764968.398859:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222089984 00000100:00100000:1.0:1787764968.398881:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222090240 00000100:00100000:1.0:1787764968.398883:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222090240 00000100:00100000:1.0:1787764968.398893:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222089856 00000100:00100000:1.0:1787764968.398895:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222089856 00000100:00100000:1.0:1787764968.398906:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787764968.398912:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222089984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.398944:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1874607222089984:12345-0@lo:400:kworker.0 Request processed in 32us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764968.398950:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787764968.398960:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787764968.398964:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89154b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222090240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.398988:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89154b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874607222090240:12345-0@lo:400:kworker.0 Request processed in 23us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764968.399005:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787764968.399023:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787764968.399028:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89155a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222089856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.399053:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89155a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222089856:12345-0@lo:400:kworker.0 Request processed in 25us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764968.399059:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787764968.399076:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222089728 00000100:00100000:1.0:1787764968.399079:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222089728 00000100:00100000:1.0:1787764968.399098:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787764968.399103:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222089728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.399126:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3db9464f-230d-4339-9306-352e25163ce7+19:3286:x1874607222089728:12345-0@lo:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764968.399132:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787764968.399163:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1874607222089984:0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.399179:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222089856:0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.399186:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3db9464f-230d-4339-9306-352e25163ce7:3286:1874607222089728:0@lo:400:kworker.0 00000100:00100000:1.0:1787764968.399194:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1874607222090240:0@lo:400:kworker.0 00000100:00080000:0.0:1787764968.399332:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787764968.399336:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764968.399463:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222089600 00000100:00100000:2.0:1787764968.399468:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222089600 00000100:00100000:2.0:1787764968.399507:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787764968.399513:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc89157840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222089600:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787764968.399600:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787764968.399724:0:6653:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764968.399772:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc89157840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222089600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764968.399779:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1787764968.400772:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbceb0b40 x1874607222089600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764968.400790:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbceb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222089600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787764968.781890:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787764968.782801:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764968.782843:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764968.783001:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214704384 00000100:00100000:1.0:1787764968.783010:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214704384 00000100:00100000:1.0:1787764968.783085:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 10 00000100:00100000:1.0:1787764968.783094:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214704384:12345-192.168.202.45@tcp:41:mkdir.0 00000004:00000024:1.0:1787764968.783134:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787764968.783232:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214704384:12345-192.168.202.45@tcp:41:mkdir.0 Request processed in 139us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764968.783240:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 10 00000100:00100000:0.0:1787764968.783621:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214704512 00000100:00100000:0.0:1787764968.783626:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214704512 00000100:00100000:0.0:1787764968.783658:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 0 00000100:00100000:0.0:1787764968.783664:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:9900:x1874607214704512:12345-192.168.202.45@tcp:700:mkdir.0 00000100:00100000:0.0:1787764968.783701:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:9900:x1874607214704512:12345-192.168.202.45@tcp:700:mkdir.0 Request processed in 37us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764968.783707:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 0 00000100:00080000:3.0:1787764968.783866:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787764968.786059:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764968.786187:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214704768 00000100:00100000:0.0:1787764968.786196:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214704768 00000100:00100000:0.0:1787764968.786245:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 11 00000100:00100000:0.0:1787764968.786253:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:9900:x1874607214704768:12345-192.168.202.45@tcp:36:mkdir.0 00010000:00010000:0.0:1787764968.786300:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764968.786365:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e238a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b27f expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.786384:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002ca00) 00010000:00010000:0.0:1787764968.786395:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764968.786818:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.786831:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.786840:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.786873:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.786881:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.786888:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764968.793294:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787764968.793318:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.793329:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.793338:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.793359:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc88587200 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764968.793364:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.793371:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.793388:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002c700) 00010000:00010000:0.0:1787764968.793392:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787764968.793396:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.793403:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e2478 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787764968.793424:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000282fc134 reply state 00000000b51ef745 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764968.793433:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787764968.793794:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+7:9900:x1874607214704768:12345-192.168.202.45@tcp:36:mkdir.0 Request processed in 7536us (7743us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787764968.793804:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 11 00010000:00010000:2.0:1787764968.799899:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.799916:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.799924:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.799930:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc88586a00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:2.0:1787764968.799935:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.799944:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.799971:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90dc9002c000) 00010000:00010000:2.0:1787764968.799974:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787764968.799979:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.799986:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e247f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764968.824352:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764968.824840:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214704896 00000100:00100000:1.0:1787764968.824850:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214704896 00000100:00100000:1.0:1787764968.824906:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 12 00000100:00100000:1.0:1787764968.824916:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:9901:x1874607214704896:12345-192.168.202.45@tcp:101:chmod.0 00010000:00010000:1.0:1787764968.824937:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764968.824968:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e2486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2a2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.825062:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e248d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.825074:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e248d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.825086:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e248d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764968.825139:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787764968.825143:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787764968.825179:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e248d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.825201:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e2486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2a2 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.825219:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e248d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2a2 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.825227:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9330fb00) 00010000:00010000:1.0:1787764968.825230:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787764968.825245:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc85daaa00, rc 0) 00000100:00100000:1.0:1787764968.825305:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+7:9901:x1874607214704896:12345-192.168.202.45@tcp:101:chmod.0 Request processed in 391us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764968.825312:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 12 00000100:00100000:1.0:1787764968.827853:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764968.827918:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214705152 00000100:00100000:2.0:1787764968.827927:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214705152 00000100:00100000:2.0:1787764968.827985:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 13 00000100:00100000:2.0:1787764968.828006:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc891561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+7:9901:x1874607214705152:12345-192.168.202.45@tcp:36:chmod.0 00010000:00010000:2.0:1787764968.828069:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787764968.828090:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e248d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2a2 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.828107:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9330fb00) 00010000:00010000:2.0:1787764968.828116:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787764968.828135:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.828145:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.828155:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787764968.828410:0:5803:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085c34025 reply state 000000000b912504 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764968.828420:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787764968.828432:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787764968.828511:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc891561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+8:9901:x1874607214705152:12345-192.168.202.45@tcp:36:chmod.0 Request processed in 508us (665us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787764968.829946:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 13 00010000:00010000:1.0:1787764968.830094:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.830103:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.830111:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.830118:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940cec00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764968.830123:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.830131:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.830143:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc83adc700) 00010000:00010000:1.0:1787764968.830146:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787764968.830150:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764968.830156:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e2494 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764968.906169:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764968.906356:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214705280 00000100:00100000:2.0:1787764968.906366:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214705280 00000100:00100000:2.0:1787764968.906422:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 14 00000100:00100000:2.0:1787764968.906432:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc891570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+7:9902:x1874607214705280:12345-192.168.202.45@tcp:101:chown.0 00010000:00010000:2.0:1787764968.906460:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764968.906484:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cee00/0x3ec49d1dfa4e249b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2a9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.906570:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e24a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.906767:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e24a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.906780:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e24a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787764968.906836:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787764968.906840:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787764968.906880:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e24a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.906905:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cee00/0x3ec49d1dfa4e249b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2a9 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.906922:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e24a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2a9 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764968.906930:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc83adc000) 00010000:00010000:2.0:1787764968.906933:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787764968.906936:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cec00, rc 0) 00000100:00100000:2.0:1787764968.907011:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc891570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+8:9902:x1874607214705280:12345-192.168.202.45@tcp:101:chown.0 Request processed in 580us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764968.907017:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 14 00000100:00100000:3.0:1787764968.910001:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764968.911301:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214705408 00000100:00100000:0.0:1787764968.911312:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214705408 00000100:00100000:0.0:1787764968.911374:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 15 00000100:00100000:0.0:1787764968.911383:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+8:9902:x1874607214705408:12345-192.168.202.45@tcp:101:chown.0 00010000:00010000:0.0:1787764968.911405:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764968.911424:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e24a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2b0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911525:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911539:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911549:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911563:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911570:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911577:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911687:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e24be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911695:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e24be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911702:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e24be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764968.911735:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787764968.911739:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787764968.911760:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e24be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911780:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911787:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911794:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911801:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc88587e00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764968.911805:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911813:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911824:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc83adc000) 00010000:00010000:0.0:1787764968.911827:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787764968.911831:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911837:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587e00/0x3ec49d1dfa4e24b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911848:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911855:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911861:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911870:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc88587400 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764968.911873:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911879:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911885:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90dc9002c700) 00010000:00010000:0.0:1787764968.911888:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787764968.911890:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911896:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587400/0x3ec49d1dfa4e24b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911924:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88587200/0x3ec49d1dfa4e24a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2b0 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911936:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e24be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2b0 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764968.911944:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9002ca00) 00010000:00010000:0.0:1787764968.911946:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787764968.911948:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc88586a00, rc 0) 00000100:00100000:0.0:1787764968.912215:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+9:9902:x1874607214705408:12345-192.168.202.45@tcp:101:chown.0 Request processed in 831us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764968.912222:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 15 00000100:00100000:1.0:1787764968.923550:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764968.923735:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214705664 00000100:00100000:3.0:1787764968.923744:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214705664 00000100:00100000:3.0:1787764968.923791:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 16 00000100:00100000:3.0:1787764968.923800:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+9:9902:x1874607214705664:12345-192.168.202.45@tcp:36:chown.0 00010000:00010000:3.0:1787764968.923849:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787764968.923874:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc88586a00/0x3ec49d1dfa4e24be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2b0 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764968.923892:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9002ca00) 00010000:00010000:3.0:1787764968.923902:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764968.923935:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764968.923949:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764968.923964:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787764968.967219:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1787764968.967245:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1787764969.028399:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787764969.029076:0:6674:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000329522a3 reply state 000000006151d8b0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764969.029090:0:6674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787764969.029217:0:6674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787764969.029301:0:6674:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787764969.029324:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+7:9902:x1874607214705664:12345-192.168.202.45@tcp:36:chown.0 Request processed in 105521us (105779us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787764969.029341:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 16 00010000:00010000:2.0:1787764969.029809:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.029828:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.029836:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.029843:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130c00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:2.0:1787764969.029847:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.029855:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.029870:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc8e20b600) 00010000:00010000:2.0:1787764969.029873:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787764969.029877:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.029884:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130c00/0x3ec49d1dfa4e24c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764969.048829:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764969.049199:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214705792 00000100:00100000:0.0:1787764969.049209:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214705792 00000100:00100000:0.0:1787764969.049276:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 17 00000100:00100000:0.0:1787764969.049286:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:9903:x1874607214705792:12345-192.168.202.45@tcp:101:touch.500 00010000:00010000:0.0:1787764969.049309:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764969.049329:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e24cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2b7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787764969.053680:0:5803:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4303us 00010000:00010000:1.0:1787764969.063119:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063143:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063154:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063167:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063173:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063179:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063480:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daba00/0x3ec49d1dfa4e24e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063489:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daba00/0x3ec49d1dfa4e24e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063497:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daba00/0x3ec49d1dfa4e24e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764969.063560:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787764969.063564:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787764969.063667:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daba00/0x3ec49d1dfa4e24e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063683:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063687:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063692:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063696:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85dabe00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764969.063699:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063704:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063712:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc83adc000) 00010000:00010000:1.0:1787764969.063714:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764969.063717:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063721:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e24d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063728:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063731:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063734:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063741:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85daaa00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764969.063743:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063746:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063750:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90dc9330f400) 00010000:00010000:1.0:1787764969.063751:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764969.063753:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063756:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e24da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063782:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e24cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2b7 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063792:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daba00/0x3ec49d1dfa4e24e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2b7 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.063796:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9330fa00) 00010000:00010000:1.0:1787764969.063797:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787764969.063798:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc85daba00, rc 0) 00000100:00100000:1.0:1787764969.063856:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+7:9903:x1874607214705792:12345-192.168.202.45@tcp:101:touch.500 Request processed in 14572us (15033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764969.063862:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 17 00000100:00100000:2.0:1787764969.069164:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764969.079076:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214706048 00000100:00100000:1.0:1787764969.079105:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214706048 00000100:00100000:1.0:1787764969.079169:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 18 00000100:00100000:1.0:1787764969.079180:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+7:9903:x1874607214706048:12345-192.168.202.45@tcp:101:touch.500 00010000:00010000:1.0:1787764969.079203:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764969.079220:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e24e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2be expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.079472:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.079483:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.079492:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.079501:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.079505:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.079509:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787764969.080333:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787764969.080892:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e24fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.080905:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e24fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.080925:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e24fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.080957:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.080963:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.080970:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.080976:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85dabc00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764969.080980:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.080997:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.081010:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9330fa00) 00010000:00010000:1.0:1787764969.081013:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764969.081018:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.081024:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e24ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787764969.081033:0:5804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006cca077 reply state 0000000004683a3f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764969.081039:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787764969.081381:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e24e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2be expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.081394:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e24fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2be expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.081399:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90dc9330f200) 00010000:00010000:1.0:1787764969.081401:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787764969.081402:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc85dab600, rc 0) 00000100:00100000:1.0:1787764969.081467:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+10:9903:x1874607214706048:12345-192.168.202.45@tcp:101:touch.500 Request processed in 2288us (12309us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787764969.081475:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 18 00010000:00010000:0.0:1787764969.083015:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.083027:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.083033:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.083039:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85dab400 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764969.083043:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.083059:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.083072:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff90dc9330fd00) 00010000:00010000:0.0:1787764969.083076:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787764969.083079:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.083085:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab400/0x3ec49d1dfa4e24f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764969.083915:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764969.084152:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214706304 00000100:00100000:1.0:1787764969.084161:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214706304 00000100:00100000:1.0:1787764969.084208:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 19 00000100:00100000:1.0:1787764969.084216:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+9:9903:x1874607214706304:12345-192.168.202.45@tcp:36:touch.500 00010000:00010000:1.0:1787764969.084258:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764969.084272:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e24fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2be expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.084280:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90dc9330f200) 00010000:00010000:1.0:1787764969.084284:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764969.084312:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.084321:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.084326:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787764969.084430:0:5805:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082cbc737 reply state 0000000059d14673 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764969.084436:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787764969.084500:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+10:9903:x1874607214706304:12345-192.168.202.45@tcp:36:touch.500 Request processed in 285us (588us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787764969.084507:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 19 00010000:00010000:1.0:1787764969.085867:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.085875:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.085880:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.085883:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85daaa00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764969.085886:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.085891:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.085900:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90dc9330f400) 00010000:00010000:1.0:1787764969.085902:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764969.085904:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.085908:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e250b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764969.085984:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.086066:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214706432 00000100:00100000:3.0:1787764969.086071:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214706432 00000100:00100000:3.0:1787764969.086102:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 20 00000100:00100000:3.0:1787764969.086108:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+9:9903:x1874607214706432:12345-192.168.202.45@tcp:101:touch.500 00010000:00010000:3.0:1787764969.086123:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764969.086134:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2512 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2c5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.086172:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2c5 expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.086180:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2c5 expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.086190:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90dc8e20b800) 00010000:00010000:3.0:1787764969.086192:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787764969.086194:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc93130e00, rc 0) 00000100:00100000:3.0:1787764969.086227:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+10:9903:x1874607214706432:12345-192.168.202.45@tcp:101:touch.500 Request processed in 119us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764969.086231:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 20 00000100:00100000:3.0:1787764969.087767:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764969.087820:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214706560 00000100:00100000:0.0:1787764969.087825:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214706560 00000100:00100000:0.0:1787764969.087858:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 12 00000100:00100000:0.0:1787764969.087864:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2363:x1874607214706560:12345-192.168.202.45@tcp:8:touch.500 00010000:00080000:0.0:1787764969.087891:0:6845:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:0.0:1787764969.087915:0:6845:0:(genops.c:1385:class_connect()) connect: client 5045b8d5-7523-47ae-bf71-6d43e6178916, cookie 0x3ec49d1dfa4e2519 00002000:00100000:0.0:1787764969.087923:0:6845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5045b8d5-7523-47ae-bf71-6d43e6178916/ffff90dcbbd82800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113976 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787764969.087931:0:6845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 77, return 77 00002000:00080000:0.0:1787764969.088230:0:6845:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787764969.088260:0:6845:0:(import.c:65:import_set_state_nolock()) ffff90dcbbd86800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787764969.088310:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2363:x1874607214706560:12345-192.168.202.45@tcp:8:touch.500 Request processed in 444us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764969.088316:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 12 00000100:00100000:2.0:1787764969.090185:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764969.096293:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214706688 00000100:00100000:1.0:1787764969.096306:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214706688 00000100:00100000:1.0:1787764969.096372:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 13 00000100:00100000:1.0:1787764969.096380:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+6:0:x1874607214706688:12345-192.168.202.45@tcp:2:touch.500 00000100:00080000:3.0:1787764969.098273:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787764969.144823:0:7605:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5045b8d5-7523-47ae-bf71-6d43e6178916 00000001:00080000:3.0:1787764969.144838:0:7605:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787764969.144955:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+5:0:x1874607214706688:12345-192.168.202.45@tcp:2:touch.500 Request processed in 48571us (54768us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787764969.144966:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 13 00000100:00100000:2.0:1787764969.147019:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.147228:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214706944 00000100:00100000:3.0:1787764969.147248:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214706944 00000100:00100000:3.0:1787764969.147298:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 1 00000100:00100000:3.0:1787764969.147306:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+10:9903:x1874607214706944:12345-192.168.202.45@tcp:35:touch.500 00000100:00100000:3.0:1787764969.147568:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+11:9903:x1874607214706944:12345-192.168.202.45@tcp:35:touch.500 Request processed in 263us (557us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787764969.147574:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 1 00000100:00100000:3.0:1787764969.158924:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764969.159016:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214707072 00000100:00100000:1.0:1787764969.159025:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214707072 00000100:00100000:1.0:1787764969.159105:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 21 00000100:00100000:1.0:1787764969.159112:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+11:9904:x1874607214707072:12345-192.168.202.45@tcp:101:rm.0 00010000:00010000:1.0:1787764969.159132:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764969.159148:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e2520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2cc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.159201:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e2527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.159212:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e2527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.159221:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e2527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764969.159267:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787764969.159269:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787764969.159300:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e2527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.159331:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daaa00/0x3ec49d1dfa4e2520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2cc expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.159344:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e2527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2cc expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.159350:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9330fa00) 00010000:00010000:1.0:1787764969.159352:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787764969.159355:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc85dab600, rc 0) 00000100:00100000:1.0:1787764969.159405:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+12:9904:x1874607214707072:12345-192.168.202.45@tcp:101:rm.0 Request processed in 293us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764969.159409:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 21 00000100:00100000:3.0:1787764969.162755:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764969.169817:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214707328 00000100:00100000:2.0:1787764969.169828:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214707328 00000100:00100000:2.0:1787764969.169918:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 22 00000100:00100000:2.0:1787764969.169926:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+12:9904:x1874607214707328:12345-192.168.202.45@tcp:101:rm.0 00010000:00010000:2.0:1787764969.169943:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764969.169960:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e252e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2d3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787764969.170090:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787764969.170237:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e252e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2d3 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.170249:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc83adc000) 00010000:00010000:2.0:1787764969.170251:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787764969.170254:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e252e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2d3 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.170264:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cf000, rc 0) 00000100:00100000:2.0:1787764969.170315:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+13:9904:x1874607214707328:12345-192.168.202.45@tcp:101:rm.0 Request processed in 390us (7570us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787764969.170320:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 22 00000100:00100000:0.0:1787764969.174935:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.175011:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214707456 00000100:00100000:3.0:1787764969.175020:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214707456 00000100:00100000:3.0:1787764969.175071:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 2 00000100:00100000:3.0:1787764969.175078:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+13:9904:x1874607214707456:12345-192.168.202.45@tcp:37:rm.0 00000100:00100000:3.0:1787764969.197997:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+13:9904:x1874607214707456:12345-192.168.202.45@tcp:37:rm.0 Request processed in 22897us (23048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764969.198011:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 2 00000100:00100000:2.0:1787764969.203963:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764969.204062:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214707712 00000100:00100000:0.0:1787764969.204070:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214707712 00000100:00100000:0.0:1787764969.204115:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 3 00000100:00100000:0.0:1787764969.204121:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+13:9904:x1874607214707712:12345-192.168.202.45@tcp:35:rm.0 00000100:00100000:0.0:1787764969.204332:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+14:9904:x1874607214707712:12345-192.168.202.45@tcp:35:rm.0 Request processed in 211us (377us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787764969.204337:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 3 00000100:00100000:0.0:1787764969.207449:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764969.207544:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214707968 00000100:00100000:2.0:1787764969.207552:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214707968 00000100:00100000:2.0:1787764969.207637:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 23 00000100:00100000:2.0:1787764969.207648:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+14:9904:x1874607214707968:12345-192.168.202.45@tcp:101:rm.0 00010000:00010000:2.0:1787764969.207672:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764969.207692:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e253c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2da expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.207805:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940ce400/0x3ec49d1dfa4e2543 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.207816:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940ce400/0x3ec49d1dfa4e2543 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.207824:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940ce400/0x3ec49d1dfa4e2543 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787764969.207832:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787764969.207917:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e253c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2da expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.207942:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940ce400/0x3ec49d1dfa4e2543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2da expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.207949:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9330fa00) 00010000:00010000:2.0:1787764969.207951:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787764969.207953:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940ce400, rc 0) 00000100:00100000:2.0:1787764969.208014:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9904:x1874607214707968:12345-192.168.202.45@tcp:101:rm.0 Request processed in 368us (574us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787764969.208021:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 23 00000100:00100000:2.0:1787764969.210569:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.210656:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214708096 00000100:00100000:3.0:1787764969.210665:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214708096 00000100:00100000:3.0:1787764969.210707:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 24 00000100:00100000:3.0:1787764969.210714:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9904:x1874607214708096:12345-192.168.202.45@tcp:41:rm.0 00000004:00000024:3.0:1787764969.210759:0:6674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787764969.210804:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9904:x1874607214708096:12345-192.168.202.45@tcp:41:rm.0 Request processed in 91us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764969.210809:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 24 00000100:00100000:0.0:1787764969.215909:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764969.216016:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214708224 00000100:00100000:1.0:1787764969.216024:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214708224 00000100:00100000:1.0:1787764969.216076:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 25 00000100:00100000:1.0:1787764969.216086:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9904:x1874607214708224:12345-192.168.202.45@tcp:101:rm.0 00010000:00010000:1.0:1787764969.216106:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764969.216125:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e2551 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2e1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216180:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216193:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216201:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216223:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216227:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216231:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216311:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daac00/0x3ec49d1dfa4e2566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216315:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daac00/0x3ec49d1dfa4e2566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216319:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daac00/0x3ec49d1dfa4e2566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764969.216340:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787764969.216343:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787764969.216355:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daac00/0x3ec49d1dfa4e2566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216363:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daac00/0x3ec49d1dfa4e2566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216368:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216372:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216382:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216386:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85dabc00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764969.216389:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216394:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216402:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9330fa00) 00010000:00010000:1.0:1787764969.216404:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764969.216407:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216411:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabc00/0x3ec49d1dfa4e2558 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216419:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216422:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216426:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216429:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85dabe00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764969.216431:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216440:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216448:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff90dc9330fe00) 00010000:00010000:1.0:1787764969.216451:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764969.216454:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216459:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dabe00/0x3ec49d1dfa4e255f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216486:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e2551 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2e1 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216500:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daac00/0x3ec49d1dfa4e2566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2e1 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.216506:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90dc8e20b800) 00010000:00010000:1.0:1787764969.216508:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787764969.216511:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc85daac00, rc 0) 00000100:00100000:1.0:1787764969.216768:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+17:9904:x1874607214708224:12345-192.168.202.45@tcp:101:rm.0 Request processed in 684us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764969.216773:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 25 00000100:00100000:1.0:1787764969.219241:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.220037:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214708480 00000100:00100000:3.0:1787764969.220056:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214708480 00000100:00100000:3.0:1787764969.220109:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 26 00000100:00100000:3.0:1787764969.220132:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+17:9904:x1874607214708480:12345-192.168.202.45@tcp:36:rm.0 00010000:00010000:3.0:1787764969.220184:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787764969.220207:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daac00/0x3ec49d1dfa4e2566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2e1 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220231:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2512 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2c5 expref: 16 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220243:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90dc8e20b800) 00010000:00010000:3.0:1787764969.220257:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab600/0x3ec49d1dfa4e2527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2cc expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220266:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9330fa00) 00010000:00010000:3.0:1787764969.220268:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764969.220287:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220300:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220309:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220323:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220330:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220337:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220749:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220758:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.220766:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787764969.221641:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787764969.221653:0:6674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 278808068122ns, next at 279808066022ns, rc = 0 00010000:00010000:3.0:1787764969.221707:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221717:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221725:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221733:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221739:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221745:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221768:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787764969.221786:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.221794:0:6664:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787764969.221798:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.221804:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221804:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.221811:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131e00 already unused, calling callback (ffffffffc15ff530) 00010000:00010000:3.0:1787764969.221811:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131a00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764969.221815:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221815:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.221823:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221824:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221840:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90dc8e20b200) 00010000:00010000:3.0:1787764969.221843:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787764969.221845:0:6664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90dc8e20b200) 00010000:00010000:3.0:1787764969.221846:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.221847:0:6664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787764969.221850:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221853:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e257b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.221856:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131e00/0x3ec49d1dfa4e2582 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.221874:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764969.221875:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764969.221877:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764969.221880:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221885:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221891:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221896:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131800 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:3.0:1787764969.221905:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221911:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221919:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9330fa00) 00010000:00010000:3.0:1787764969.221921:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764969.221924:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.221930:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e256d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787764969.221942:0:6674:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd1dbe50 reply state 000000003dd5dc7e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764969.221950:0:6674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787764969.222038:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9904:x1874607214708480:12345-192.168.202.45@tcp:36:rm.0 Request processed in 1905us (2797us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787764969.222045:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 26 00010000:00010000:0.0:1787764969.224390:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.224405:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.224413:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.224419:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130a00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764969.224423:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.224442:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.224456:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff90dc8e20b000) 00010000:00010000:0.0:1787764969.224459:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787764969.224463:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.224469:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130a00/0x3ec49d1dfa4e2574 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764969.229194:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764969.229363:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214708736 00000100:00100000:0.0:1787764969.229372:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214708736 00000100:00100000:0.0:1787764969.229417:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 4 00000100:00100000:0.0:1787764969.229424:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc88fbf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+15:9904:x1874607214708736:12345-192.168.202.45@tcp:35:rm.0 00000100:00100000:0.0:1787764969.229844:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc88fbf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9904:x1874607214708736:12345-192.168.202.45@tcp:35:rm.0 Request processed in 419us (659us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787764969.229850:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 4 00000100:00100000:2.0:1787764969.232255:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.232314:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214708992 00000100:00100000:3.0:1787764969.232321:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214708992 00000100:00100000:3.0:1787764969.232365:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 27 00000100:00100000:3.0:1787764969.232372:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9904:x1874607214708992:12345-192.168.202.45@tcp:36:rm.0 00010000:00010000:3.0:1787764969.232418:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787764969.232438:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940ce400/0x3ec49d1dfa4e2543 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2da expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.232459:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daba00/0x3ec49d1dfa4e24e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2b7 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.232490:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc9330fa00) 00010000:00010000:3.0:1787764969.232507:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cec00/0x3ec49d1dfa4e24a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2a9 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.232524:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc83adc000) 00010000:00010000:3.0:1787764969.232534:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787764969.232556:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.232568:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.232578:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.232811:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.232817:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.232822:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.233143:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.233150:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764969.233161:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787764969.234712:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787764969.234731:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234751:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234758:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234764:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130e00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:2.0:1787764969.234768:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234775:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234787:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90dc8e20bf00) 00010000:00010000:2.0:1787764969.234790:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787764969.234794:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234800:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130e00/0x3ec49d1dfa4e2597 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234821:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234828:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234833:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234837:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131800 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:2.0:1787764969.234846:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234853:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234860:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc8e20b800) 00010000:00010000:2.0:1787764969.234863:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787764969.234866:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764969.234872:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131800/0x3ec49d1dfa4e2589 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787764969.234894:0:5804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000422cee78 reply state 000000000efa4e56 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764969.234903:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787764969.235057:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+15:9904:x1874607214708992:12345-192.168.202.45@tcp:36:rm.0 Request processed in 2674us (2795us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787764969.235066:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 27 00010000:00010000:1.0:1787764969.237830:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.237841:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.237855:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.237859:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131a00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764969.237862:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.237866:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.237876:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90dc8e20bd00) 00010000:00010000:1.0:1787764969.237879:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764969.237882:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.237886:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131a00/0x3ec49d1dfa4e2590 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764969.343349:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764969.343522:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214709120 00000100:00100000:0.0:1787764969.343532:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214709120 00000100:00100000:0.0:1787764969.343629:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 28 00000100:00100000:0.0:1787764969.343640:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+14:9908:x1874607214709120:12345-192.168.202.45@tcp:101:getfattr.0 00010000:00010000:0.0:1787764969.343665:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764969.343687:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045e00/0x3ec49d1dfa4e259e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2e8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.343750:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.343778:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.343789:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764969.343848:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787764969.343851:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787764969.343892:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.343919:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045e00/0x3ec49d1dfa4e259e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2e8 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.343937:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2e8 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.343944:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002c900) 00010000:00010000:0.0:1787764969.343946:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787764969.343949:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dcc2045800, rc 0) 00000100:00100000:0.0:1787764969.344021:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+15:9908:x1874607214709120:12345-192.168.202.45@tcp:101:getfattr.0 Request processed in 384us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764969.344029:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 28 00000100:00100000:2.0:1787764969.348628:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.348800:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214709248 00000100:00100000:3.0:1787764969.348810:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214709248 00000100:00100000:3.0:1787764969.348857:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 5 00000100:00100000:3.0:1787764969.348864:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+15:9908:x1874607214709248:12345-192.168.202.45@tcp:33:getfattr.0 00000004:00200000:3.0:1787764969.348946:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787764969.348950:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:3.0:1787764969.349037:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+15:9908:x1874607214709248:12345-192.168.202.45@tcp:33:getfattr.0 Request processed in 172us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764969.349045:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 5 00000100:00100000:2.0:1787764969.400504:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764969.400705:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214709504 00000100:00100000:1.0:1787764969.400715:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214709504 00000100:00100000:1.0:1787764969.400780:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 29 00000100:00100000:1.0:1787764969.400790:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+15:9913:x1874607214709504:12345-192.168.202.45@tcp:36:lfs.0 00010000:00010000:1.0:1787764969.400841:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764969.400868:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2e8 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.400888:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002c900) 00010000:00010000:1.0:1787764969.400899:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764969.400935:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.400948:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764969.400958:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787764969.401209:0:5803:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000251fe4b4 reply state 00000000675a91ac transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764969.401219:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787764969.401232:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787764969.401387:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9913:x1874607214709504:12345-192.168.202.45@tcp:36:lfs.0 Request processed in 598us (904us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787764969.401395:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 29 00010000:00010000:0.0:1787764969.408118:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.408135:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.408159:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.408166:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85daa600 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764969.408180:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.408190:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.408207:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9330fe00) 00010000:00010000:0.0:1787764969.408210:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787764969.408215:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.408222:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa600/0x3ec49d1dfa4e25ac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764969.428874:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764969.429151:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214709632 00000100:00100000:0.0:1787764969.429162:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214709632 00000100:00100000:0.0:1787764969.429218:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 30 00000100:00100000:0.0:1787764969.429228:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+15:9914:x1874607214709632:12345-192.168.202.45@tcp:101:lfs.0 00010000:00010000:0.0:1787764969.429252:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764969.429275:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045c00/0x3ec49d1dfa4e25b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2ef expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.429338:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.429351:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.429374:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764969.429436:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787764969.429440:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787764969.429466:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.429503:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045c00/0x3ec49d1dfa4e25b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2ef expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.429528:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2ef expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764969.429537:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002c700) 00010000:00010000:0.0:1787764969.429540:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787764969.429543:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dcc2045800, rc 0) 00000100:00100000:0.0:1787764969.429647:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9914:x1874607214709632:12345-192.168.202.45@tcp:101:lfs.0 Request processed in 419us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764969.429654:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 30 00000100:00100000:2.0:1787764969.435799:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.436056:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214709760 00000100:00100000:3.0:1787764969.436066:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214709760 00000100:00100000:3.0:1787764969.436135:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 6 00000100:00100000:3.0:1787764969.436147:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbceb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9914:x1874607214709760:12345-192.168.202.45@tcp:33:lfs.0 00000004:00200000:3.0:1787764969.436243:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787764969.436248:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:3.0:1787764969.436329:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbceb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+16:9914:x1874607214709760:12345-192.168.202.45@tcp:33:lfs.0 Request processed in 185us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764969.436337:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 6 00010000:00010000:2.0:1787764969.805993:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764969.913300:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764969.913349:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764969.913445:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214709888 00000100:00100000:3.0:1787764969.913454:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214709888 00000100:00100000:3.0:1787764969.913517:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 248 00000100:00100000:3.0:1787764969.913527:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214709888:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764969.913674:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2364:x1874607214709888:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 148us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764969.913695:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 248 00000100:00100000:0.0:1787764969.913955:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214710016 00000100:00100000:0.0:1787764969.913959:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214710016 00000100:00100000:0.0:1787764969.914009:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 57 00000100:00100000:0.0:1787764969.914017:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214710016:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764969.914047:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2364:x1874607214710016:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 31us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764969.914053:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 57 00000100:00100000:3.0:1787764970.446443:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222090368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787764970.446781:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764970.447386:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222090368 00000100:00100000:2.0:1787764970.447395:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222090368 00000100:00100000:1.0:1787764970.447638:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787764970.447652:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222090368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787764970.447697:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787764970.447757:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222090368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764970.447765:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1787764970.447905:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbc8e43c0 x1874607222090368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764970.448031:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222090368:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787764970.448205:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787764970.843273:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787764971.857633:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787764972.880056:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787764973.517938:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222090624:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518014:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764973.518069:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222091136:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518098:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764973.518126:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787764973.518131:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222090496:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518154:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764973.518170:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222091008:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518189:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764973.518210:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222090752:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518230:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764973.518245:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787764973.518249:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222090880:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518266:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764973.518291:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222090624 00000100:00100000:0.0:1787764973.518297:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222090624 00000100:00100000:0.0:1787764973.518332:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222091008 00000100:00100000:0.0:1787764973.518335:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222091008 00000100:00100000:0.0:1787764973.518350:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222090752 00000100:00100000:0.0:1787764973.518352:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222090752 00000100:00100000:0.0:1787764973.518364:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787764973.518372:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222090624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518431:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874607222090624:12345-0@lo:400:kworker.0 Request processed in 60us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764973.518449:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787764973.518466:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787764973.518472:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222091008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518501:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222091008:12345-0@lo:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764973.518507:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787764973.518518:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787764973.518523:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222090752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518567:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222090752:12345-0@lo:400:kworker.0 Request processed in 44us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764973.518603:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787764973.518621:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222091136 00000100:00100000:0.0:1787764973.518624:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222091136 00000100:00100000:0.0:1787764973.518647:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222090880 00000100:00100000:0.0:1787764973.518650:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222090880 00000100:00100000:0.0:1787764973.518663:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787764973.518668:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbcab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222091136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518696:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbcab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222091136:12345-0@lo:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764973.518702:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787764973.518711:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787764973.518716:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222090880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518735:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222090880:12345-0@lo:400:kworker.0 Request processed in 20us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764973.518749:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787764973.518765:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222090496 00000100:00100000:0.0:1787764973.518768:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222090496 00000100:00100000:0.0:1787764973.518786:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787764973.518791:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222090496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518817:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222090496:12345-0@lo:400:kworker.0 Request processed in 26us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764973.518823:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:0.0:1787764973.518868:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbc8e52c0 x1874607222090880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764973.518881:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222090880:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518890:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222090752:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518911:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222090496:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518919:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222091008:0@lo:400:kworker.0 00000100:00100000:0.0:1787764973.518926:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874607222090624:0@lo:400:kworker.0 00010000:00080000:0.0:1787764973.518934:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbc8e6d00 x1874607222091136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787764989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787764973.518942:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222091136:0@lo:400:kworker.0 00000100:00080000:3.0:1787764973.519149:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787764973.519153:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787764973.519156:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787764973.519580:0:8166:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 283105994017ns, next at 284105991399ns, rc = 0 00000100:00100000:3.0:1787764973.522723:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787764973.522764:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222091264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787764973.522861:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764973.523012:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222091264 00000100:00100000:2.0:1787764973.523021:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222091264 00000100:00100000:2.0:1787764973.523082:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787764973.523093:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222091264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787764973.523132:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764973.523181:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1874607222091264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764973.523188:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787764973.527984:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90dcbce48f00 x1874607222091264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787764973.528014:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1874607222091264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787764973.902030:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787764974.168182:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:0.0:1787764974.168212:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000004:00080000:0.0:1787764974.168226:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1787764974.168248:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787764974.170545:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787764974.170577:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbce4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222091392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787764974.170664:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764974.170873:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222091392 00000100:00100000:0.0:1787764974.170881:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222091392 00000100:00100000:0.0:1787764974.170933:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787764974.170954:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222091392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787764974.170983:0:6648:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787764974.171020:0:6648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f20e9, atime: 0x6a8f20e9, ctime: 0x6a8f20e9, blocks: 0x1 00010000:00010000:0.0:1787764974.171029:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.171047:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=283s v=(0 0) 00010000:00010000:0.0:1787764974.171051:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787764974.171058:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.171079:0:6648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.171090:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.171098:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.171117:0:6648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787764974.175891:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1874607222091392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4939us (5216us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787764974.175906:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787764974.175966:0:6664:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787764974.175975:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.175988:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dcc2045a00 already unused, calling callback (ffffffffc15ff530) 00010000:00010000:0.0:1787764974.175993:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.176005:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.176026:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.176034:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f86b0b8/0x3ec49d1dfa4e25c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764974.176053:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764974.176055:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787764974.176056:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787764974.176168:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90dcbce4a940/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787764974.176175:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbce4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222091392:0@lo:6:osp-syn-1-0.0 00000001:02000400:3.0:1787764974.618626:0:11682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-compr test 2002: Compr stat is valid in case of ENOMEM ========================================================== 13:22:50 (1787764970) 00000001:00080000:3.0:1787764974.654212:0:7605:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1787764974.926012:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764975.036047:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764975.036420:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214710144 00000100:00100000:3.0:1787764975.036429:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214710144 00000100:00100000:3.0:1787764975.036636:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 250 00000100:00100000:3.0:1787764975.036647:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214710144:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:3.0:1787764975.036725:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60ac3458-f656-46a2-8942-5ca7481f30b9+10:2366:x1874607214710144:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 80us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787764975.038274:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 250 00000100:00100000:2.0:1787764975.051958:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764975.057410:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764975.058799:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214710272 00000100:00100000:0.0:1787764975.058816:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214710272 00000100:00100000:0.0:1787764975.058888:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 124 00000100:00100000:0.0:1787764975.058898:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbce48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214710272:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:0.0:1787764975.058995:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbce48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2367:x1874607214710272:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 98us (7048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764975.059016:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 124 00000100:00100000:2.0:1787764975.059722:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214710400 00000100:00100000:2.0:1787764975.059727:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214710400 00000100:00100000:2.0:1787764975.059774:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 60 00000100:00100000:2.0:1787764975.059782:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2366:x1874607214710400:12345-192.168.202.45@tcp:400:kworker.0 00000100:00100000:2.0:1787764975.059813:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+5:2366:x1874607214710400:12345-192.168.202.45@tcp:400:kworker.0 Request processed in 32us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764975.059819:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 60 00000100:00080000:2.0:1787764975.063038:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787764975.063046:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764975.566429:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787764975.566449:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222091520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787764975.566528:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787764975.566724:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222091520 00000100:00100000:2.0:1787764975.566733:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222091520 00000100:00100000:2.0:1787764975.566800:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787764975.566810:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7bd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222091520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787764975.566842:0:6652:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787764975.566889:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7bd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222091520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764975.566896:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787764975.567012:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787764975.567244:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90db81cba940 x1874607222091520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787764991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787764975.567326:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90db81cba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222091520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787764975.950061:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787764976.700460:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764976.700534:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214710528 00000100:00100000:3.0:1787764976.700562:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214710528 00000100:00100000:3.0:1787764976.700639:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 31 00000100:00100000:3.0:1787764976.700648:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:10112:x1874607214710528:12345-192.168.202.45@tcp:101:lfs.0 00010000:00010000:3.0:1787764976.700667:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787764976.700686:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131600/0x3ec49d1dfa4e25c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2f6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.700749:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.700764:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.700777:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.700791:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.700798:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.700804:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701200:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701209:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701216:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701227:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93131c00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:3.0:1787764976.701232:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701239:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701253:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002c700) 00010000:00010000:3.0:1787764976.701255:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764976.701261:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701268:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131c00/0x3ec49d1dfa4e25cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701292:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701298:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701304:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701309:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc93130600 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:3.0:1787764976.701312:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701319:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701335:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5e86211 (ffff90dc8e20bf00) 00010000:00010000:3.0:1787764976.701338:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764976.701341:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701347:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93130600/0x3ec49d1dfa4e25d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701379:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131600/0x3ec49d1dfa4e25c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2f6 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701389:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002c700) 00010000:00010000:3.0:1787764976.701392:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787764976.701396:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc93131600/0x3ec49d1dfa4e25c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2f6 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.701407:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc93131600, rc 0) 00000100:00100000:3.0:1787764976.701508:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:10112:x1874607214710528:12345-192.168.202.45@tcp:101:lfs.0 Request processed in 861us (1058us total) trans 0 rc 301/301 00000100:00100000:3.0:1787764976.701517:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 31 00000100:00100000:3.0:1787764976.710364:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764976.710438:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214710784 00000100:00100000:1.0:1787764976.710447:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214710784 00000100:00100000:1.0:1787764976.710506:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 32 00000100:00100000:1.0:1787764976.710516:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:10112:x1874607214710784:12345-192.168.202.45@tcp:101:lfs.0 00010000:00010000:1.0:1787764976.710536:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787764976.710549:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787764976.710576:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e25ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2ef expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.710622:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002c700) 00010000:00010000:1.0:1787764976.710632:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787764976.710649:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab800/0x3ec49d1dfa4e25dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b2fd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.710974:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.710987:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.710998:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.711012:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.711029:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.711036:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712090:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712103:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712111:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787764976.712121:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00010000:00010000:1.0:1787764976.712145:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712152:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712159:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712165:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85daa000 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764976.712170:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712176:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712198:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9330fe00) 00010000:00010000:1.0:1787764976.712201:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764976.712205:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712212:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daa000/0x3ec49d1dfa4e25e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787764976.712225:0:5803:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e921e3b5 reply state 0000000069bada06 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764976.712234:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787764976.712263:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab800/0x3ec49d1dfa4e25dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712280:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.712288:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90dc9330fd00) 00010000:00010000:1.0:1787764976.712291:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787764976.712293:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc85dab200, rc 0) 00000100:00100000:1.0:1787764976.712363:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+8:10112:x1874607214710784:12345-192.168.202.45@tcp:101:lfs.0 Request processed in 1849us (2007us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787764976.712372:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 32 00010000:00010000:1.0:1787764976.714260:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.714274:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.714294:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.714299:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc85daae00 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:1.0:1787764976.714303:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.714310:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.714323:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5e86211 (ffff90dc9330fa00) 00010000:00010000:1.0:1787764976.714326:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787764976.714330:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.714335:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85daae00/0x3ec49d1dfa4e25eb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764976.721432:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764976.724794:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214711040 00000100:00100000:2.0:1787764976.724807:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214711040 00000100:00100000:2.0:1787764976.724876:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 33 00000100:00100000:2.0:1787764976.724897:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90db81cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+7:10112:x1874607214711040:12345-192.168.202.45@tcp:101:lfs.0 00010000:00010000:2.0:1787764976.724928:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764976.724952:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cea00/0x3ec49d1dfa4e2600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b304 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764976.725052:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764976.725066:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764976.725075:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764976.725106:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764976.725120:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 8 pid: 5803 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787764976.725133:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcb769bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874607222091648:192.168.202.45@tcp:104: 00000100:00100000:2.0:1787764976.725218:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff90dcb33ad540 going to sleep for 11 seconds 00000100:00100000:2.0:1787764976.731437:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764976.731615:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214711168 00000100:00100000:1.0:1787764976.731624:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214711168 00010000:00010000:1.0:1787764976.731662:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 9 pid: 5803 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764976.731696:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 29 00000100:00100000:1.0:1787764976.731707:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb769a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+9:2364:x1874607214711168:12345-192.168.202.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787764976.731721:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787764976.731727:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 9 pid: 5803 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.731752:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 9 pid: 5803 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.731773:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90dc9330fd00) 00010000:00010000:1.0:1787764976.731779:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.731788:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.731794:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787764976.731811:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787764976.731860:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb769a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+9:2364:x1874607214711168:12345-192.168.202.45@tcp:103:ldlm_bl.0 Request processed in 154us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764976.731866:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 29 00010000:00010000:3.0:1787764976.732767:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc85dab200/0x3ec49d1dfa4e25f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b2fd expref: 8 pid: 5803 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787764976.732782:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcb769bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874607222091648:192.168.202.45@tcp:104: 00010000:00010000:3.0:1787764976.732800:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.732818:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.732824:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787764976.732840:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00000004:00080000:3.0:1787764976.733164:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787764976.733279:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733287:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733294:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733300:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dc940cf000 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:3.0:1787764976.733304:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733311:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733322:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90dc9330fd00) 00010000:00010000:3.0:1787764976.733324:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787764976.733328:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733334:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cf000/0x3ec49d1dfa4e2607 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733389:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cea00/0x3ec49d1dfa4e2600 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b304 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733398:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc83adc200) 00010000:00010000:3.0:1787764976.733400:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787764976.733404:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dc940cea00/0x3ec49d1dfa4e2600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b304 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787764976.733416:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cea00, rc 0) 00000100:00100000:3.0:1787764976.733450:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90db81cba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+7:10112:x1874607214711040:12345-192.168.202.45@tcp:101:lfs.0 Request processed in 8566us (12025us total) trans 4294967311 rc 301/301 00000100:00100000:3.0:1787764976.733457:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 33 00000100:00100000:3.0:1787764976.742028:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764976.742198:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214711424 00000100:00100000:0.0:1787764976.742207:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214711424 00000100:00100000:0.0:1787764976.742298:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 7 00000100:00100000:0.0:1787764976.742310:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+7:10112:x1874607214711424:12345-192.168.202.45@tcp:35:lfs.0 00000100:00100000:0.0:1787764976.742717:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+8:10112:x1874607214711424:12345-192.168.202.45@tcp:35:lfs.0 Request processed in 407us (696us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787764976.742725:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 7 00000100:00100000:1.0:1787764976.744363:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764976.744405:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214711680 00000100:00100000:3.0:1787764976.744412:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214711680 00000100:00100000:3.0:1787764976.744462:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 8 00000100:00100000:3.0:1787764976.744473:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e2892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+8:10112:x1874607214711680:12345-192.168.202.45@tcp:35:lfs.0 00000100:00100000:3.0:1787764976.744989:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e2892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+9:10112:x1874607214711680:12345-192.168.202.45@tcp:35:lfs.0 Request processed in 516us (628us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787764976.744998:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 8 00000100:00100000:2.0:1787764976.777712:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764976.777859:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214711808 00000100:00100000:0.0:1787764976.777870:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214711808 00000100:00100000:0.0:1787764976.777952:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 34 00000100:00100000:0.0:1787764976.777963:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+9:10115:x1874607214711808:12345-192.168.202.45@tcp:101:dd.0 00010000:00010000:0.0:1787764976.777984:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764976.778003:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044e00/0x3ec49d1dfa4e2615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b30b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.778058:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045400/0x3ec49d1dfa4e261c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.778072:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045400/0x3ec49d1dfa4e261c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.778084:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045400/0x3ec49d1dfa4e261c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764976.778152:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787764976.778155:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787764976.778191:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045400/0x3ec49d1dfa4e261c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.778214:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044e00/0x3ec49d1dfa4e2615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b30b expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.778229:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045400/0x3ec49d1dfa4e261c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b30b expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.778239:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002cf00) 00010000:00010000:0.0:1787764976.778243:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787764976.778246:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dcc2045400, rc 0) 00000100:00100000:0.0:1787764976.778310:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+10:10115:x1874607214711808:12345-192.168.202.45@tcp:101:dd.0 Request processed in 350us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764976.778317:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 34 00000100:00100000:1.0:1787764976.784625:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764976.784700:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214712064 00000100:00100000:0.0:1787764976.784709:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214712064 00000100:00100000:0.0:1787764976.784766:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 35 00000100:00100000:0.0:1787764976.784776:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc8e288b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+10:10115:x1874607214712064:12345-192.168.202.45@tcp:101:dd.0 00010000:00010000:0.0:1787764976.784797:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764976.784800:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787764976.784826:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045400/0x3ec49d1dfa4e261c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b30b expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.784844:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002cf00) 00010000:00010000:0.0:1787764976.784863:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764976.784878:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2623 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b312 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785039:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785051:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785061:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785074:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785081:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785088:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785154:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045200/0x3ec49d1dfa4e2638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785161:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045200/0x3ec49d1dfa4e2638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785169:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045200/0x3ec49d1dfa4e2638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787764976.785177:0:6674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00010000:00010000:0.0:1787764976.785273:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785286:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785293:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785298:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dcc2045600 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764976.785303:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785310:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785318:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90dc9002c300) 00010000:00010000:0.0:1787764976.785321:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787764976.785324:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785330:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045600/0x3ec49d1dfa4e262a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785338:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785344:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785349:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785354:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dcc2044000 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764976.785362:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785369:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785376:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5e86211 (ffff90dc9002c900) 00010000:00010000:0.0:1787764976.785379:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787764976.785382:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785388:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e2631 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5e86211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785427:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2623 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b312 expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785444:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045200/0x3ec49d1dfa4e2638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b312 expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.785451:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90dc9002ca00) 00010000:00010000:0.0:1787764976.785454:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787764976.785457:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dcc2045200, rc 0) 00000100:00100000:0.0:1787764976.785528:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc8e288b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+11:10115:x1874607214712064:12345-192.168.202.45@tcp:101:dd.0 Request processed in 752us (911us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787764976.785537:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 35 00000100:00100000:3.0:1787764976.808616:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764976.808813:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214712320 00000100:00100000:0.0:1787764976.808823:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214712320 00000100:00100000:0.0:1787764976.809141:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 36 00000100:00100000:0.0:1787764976.809150:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+11:10115:x1874607214712320:12345-192.168.202.45@tcp:36:dd.0 00010000:00010000:0.0:1787764976.809213:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787764976.809236:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045200/0x3ec49d1dfa4e2638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b312 expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.809248:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90dc9002ca00) 00010000:00010000:0.0:1787764976.809256:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787764976.809434:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.809444:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.809451:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787764976.809700:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967315 00000004:00010000:0.0:1787764976.809732:0:5803:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003007ce6b reply state 000000007119f825 transno 4294967316 ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787764976.809739:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787764976.809826:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+13:10115:x1874607214712320:12345-192.168.202.45@tcp:36:dd.0 Request processed in 676us (1250us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787764976.809833:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 36 00000020:00080000:0.0:1787764976.809838:0:5803:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787764976.811513:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.811528:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.811536:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.811556:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90dcc2045800 already unused, calling callback (ffffffffc20534f0) 00010000:00010000:0.0:1787764976.811561:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.811570:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.811608:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90dc9002c300) 00010000:00010000:0.0:1787764976.811612:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787764976.811617:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.811625:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2045800/0x3ec49d1dfa4e2646 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787764976.811788:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764976.811845:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214712448 00000100:00100000:0.0:1787764976.811853:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214712448 00000100:00100000:0.0:1787764976.811911:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 37 00000100:00100000:0.0:1787764976.811932:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+12:10115:x1874607214712448:12345-192.168.202.45@tcp:101:dd.0 00010000:00010000:0.0:1787764976.811953:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787764976.812028:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e264d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b319 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.812075:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e264d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b319 expref: 13 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.812084:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90dcc2044000/0x3ec49d1dfa4e264d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b319 expref: 13 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787764976.812160:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90dc9002c900) 00010000:00010000:0.0:1787764976.812162:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787764976.812164:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dcc2044000, rc 0) 00000100:00100000:0.0:1787764976.812211:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+13:10115:x1874607214712448:12345-192.168.202.45@tcp:101:dd.0 Request processed in 292us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764976.812218:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 37 00000100:00100000:3.0:1787764976.814125:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764976.814185:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214712576 00000100:00100000:0.0:1787764976.814191:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214712576 00000100:00100000:0.0:1787764976.814225:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 15 00000100:00100000:0.0:1787764976.814230:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2363:x1874607214712576:12345-192.168.202.45@tcp:8:dd.0 00010000:00080000:0.0:1787764976.814254:0:6648:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:0.0:1787764976.814280:0:6648:0:(genops.c:1385:class_connect()) connect: client 5045b8d5-7523-47ae-bf71-6d43e6178916, cookie 0x3ec49d1dfa4e2654 00002000:00100000:0.0:1787764976.814290:0:6648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5045b8d5-7523-47ae-bf71-6d43e6178916/ffff90dc83e1d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113976 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787764976.814299:0:6648:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 77, return 77 00002000:00080000:0.0:1787764976.814476:0:6648:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787764976.814516:0:6648:0:(import.c:65:import_set_state_nolock()) ffff90dcbd592800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787764976.814611:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2363:x1874607214712576:12345-192.168.202.45@tcp:8:dd.0 Request processed in 378us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764976.814619:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 15 00000100:00100000:3.0:1787764976.816684:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764976.816796:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214712704 00000100:00100000:2.0:1787764976.816802:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214712704 00000100:00100000:2.0:1787764976.816861:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 16 00000100:00100000:2.0:1787764976.816871:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+6:10115:x1874607214712704:12345-192.168.202.45@tcp:101:dd.0 00010000:00010000:2.0:1787764976.816898:0:6845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787764976.816933:0:6845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dffad3f5/0x3ec49d1dfa4e265b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2d7f45b93fc7b320 expref: -99 pid: 6845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787764976.816958:0:6845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787764976.816977:0:6845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1787764976.816982:0:6845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787764976.816991:0:6845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dffad3f5/0x3ec49d1dfa4e265b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b320 expref: 7 pid: 6845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764976.817010:0:6845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dffad3f5/0x3ec49d1dfa4e265b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.45@tcp remote: 0x2d7f45b93fc7b320 expref: 7 pid: 6845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787764976.817023:0:6845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90dc940cf800, rc 0) 00000100:00100000:2.0:1787764976.817074:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+7:10115:x1874607214712704:12345-192.168.202.45@tcp:101:dd.0 Request processed in 204us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787764976.817081:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 16 00000100:00080000:0.0:1787764976.817140:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787764976.818702:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764976.818810:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214712832 00000100:00100000:1.0:1787764976.818818:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214712832 00002000:00010000:1.0:1787764976.818860:0:6654:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2 (0->18446744073709551615) 00002000:00100000:1.0:1787764976.818864:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcb7698f00 with x1874607214712832 ext(0->18446744073709551615) 00002000:00010000:1.0:1787764976.818873:0:6654:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcb7698f00. 00000100:00100000:1.0:1787764976.818893:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 0 00000100:00100000:1.0:1787764976.818902:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7698f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+7:2365:x1874607214712832:12345-192.168.202.45@tcp:10:dd.0 00000001:00100000:1.0:1787764976.842058:0:6676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5045b8d5-7523-47ae-bf71-6d43e6178916 00000001:00080000:1.0:1787764976.842083:0:6676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00002000:00010000:3.0:1787764976.842265:0:6654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787764976.842270:0:6654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787764977 00002000:00010000:3.0:1787764976.842273:0:6654:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787764976.842290:0:6654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787764977 00002000:00010000:3.0:1787764976.842293:0:6654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:3.0:1787764976.842427:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7698f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214712832:12345-192.168.202.45@tcp:10:dd.0 Request processed in 23519us (23724us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787764976.842442:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 0 00002000:00010000:3.0:1787764976.842448:0:6654:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2 (0->18446744073709551615) 00002000:00100000:3.0:1787764976.842452:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcb7698f00 with x1874607214712832 ext(0->18446744073709551615) 00002000:00010000:3.0:1787764976.842458:0:6654:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcb7698f00. 00010000:00010000:0.0:1787764976.974706:0:6664:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764977.079825:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764977.080670:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214712960 00000100:00100000:2.0:1787764977.080679:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214712960 00002000:00100000:2.0:1787764977.080716:0:6656:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->528383) req@ffff90dc83c761c0 x1874607214712960/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/0 e 0 to 0 dl 1787764988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764977.080734:0:6656:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dc83c761c0 with x1874607214712960 ext(0->528383) 00002000:00010000:2.0:1787764977.080738:0:6656:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dc83c761c0 00000100:00100000:2.0:1787764977.080767:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 1 00000100:00100000:2.0:1787764977.080774:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+6:2365:x1874607214712960:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:2.0:1787764977.093436:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+8:2365:x1874607214712960:12345-192.168.202.45@tcp:4:dd.0 Request processed in 12648us (13606us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787764977.093454:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 1 00002000:00100000:2.0:1787764977.093470:0:6656:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->528383) req@ffff90dc83c761c0 x1874607214712960/t4294967300(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/448 e 0 to 0 dl 1787764988 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764977.093492:0:6656:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dc83c761c0 with x1874607214712960 ext(0->528383) 00002000:00010000:2.0:1787764977.093500:0:6656:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dc83c761c0 00000100:00100000:2.0:1787764977.183397:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764977.185881:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214713088 00000100:00100000:3.0:1787764977.186294:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214713088 00002000:00100000:3.0:1787764977.186357:0:6654:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (1048576->1576959) req@ffff90dcb76983c0 x1874607214713088/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/0 e 0 to 0 dl 1787764988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764977.186372:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcb76983c0 with x1874607214713088 ext(1048576->1576959) 00002000:00010000:3.0:1787764977.186378:0:6654:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcb76983c0 00000100:00100000:3.0:1787764977.186415:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 2 00000100:00100000:3.0:1787764977.186425:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb76983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+8:2364:x1874607214713088:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:3.0:1787764977.211637:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb76983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+10:2364:x1874607214713088:12345-192.168.202.45@tcp:4:dd.0 Request processed in 25203us (28240us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787764977.211652:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 2 00002000:00100000:3.0:1787764977.211666:0:6654:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (1048576->1576959) req@ffff90dcb76983c0 x1874607214713088/t4294967301(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/448 e 0 to 0 dl 1787764988 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764977.211677:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcb76983c0 with x1874607214713088 ext(1048576->1576959) 00002000:00010000:3.0:1787764977.211684:0:6654:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcb76983c0 00000100:00100000:0.0:1787764977.349079:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764977.349238:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214713216 00000100:00100000:2.0:1787764977.349248:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214713216 00002000:00100000:2.0:1787764977.349298:0:6656:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (2097152->2625535) req@ffff90dcbc8e43c0 x1874607214713216/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/0 e 0 to 0 dl 1787764988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764977.349309:0:6656:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbc8e43c0 with x1874607214713216 ext(2097152->2625535) 00002000:00010000:2.0:1787764977.349314:0:6656:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbc8e43c0 00000100:00100000:2.0:1787764977.349350:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 3 00000100:00100000:2.0:1787764977.349359:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+10:2365:x1874607214713216:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:3.0:1787764977.351784:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+12:2365:x1874607214713216:12345-192.168.202.45@tcp:4:dd.0 Request processed in 2416us (2703us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787764977.351806:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 3 00002000:00100000:3.0:1787764977.351820:0:6656:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (2097152->2625535) req@ffff90dcbc8e43c0 x1874607214713216/t4294967302(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/448 e 0 to 0 dl 1787764988 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764977.351829:0:6656:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbc8e43c0 with x1874607214713216 ext(2097152->2625535) 00002000:00010000:3.0:1787764977.351836:0:6656:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbc8e43c0 00000100:00100000:3.0:1787764977.610907:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764977.611366:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214713344 00000100:00100000:1.0:1787764977.611377:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214713344 00002000:00100000:1.0:1787764977.611432:0:6654:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (3145728->3674111) req@ffff90dcbd1a0780 x1874607214713344/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/0 e 0 to 0 dl 1787764988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764977.611444:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbd1a0780 with x1874607214713344 ext(3145728->3674111) 00002000:00010000:1.0:1787764977.611450:0:6654:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbd1a0780 00000100:00100000:1.0:1787764977.611487:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 4 00000100:00100000:1.0:1787764977.611497:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+12:2365:x1874607214713344:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:1.0:1787764977.617430:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+14:2365:x1874607214713344:12345-192.168.202.45@tcp:4:dd.0 Request processed in 5924us (6532us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787764977.617444:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 4 00002000:00100000:1.0:1787764977.617458:0:6654:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (3145728->3674111) req@ffff90dcbd1a0780 x1874607214713344/t4294967303(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/448 e 0 to 0 dl 1787764988 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764977.617469:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbd1a0780 with x1874607214713344 ext(3145728->3674111) 00002000:00010000:1.0:1787764977.617476:0:6654:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbd1a0780 00000100:00100000:2.0:1787764977.710657:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764977.710806:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214713472 00000100:00100000:1.0:1787764977.710817:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214713472 00002000:00100000:1.0:1787764977.710860:0:6655:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (4194304->4722687) req@ffff90dcb7698000 x1874607214713472/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/0 e 0 to 0 dl 1787764988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764977.710872:0:6655:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcb7698000 with x1874607214713472 ext(4194304->4722687) 00002000:00010000:1.0:1787764977.710877:0:6655:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcb7698000 00000100:00100000:1.0:1787764977.710965:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 5 00000100:00100000:1.0:1787764977.710976:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb7698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+14:2365:x1874607214713472:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:1.0:1787764977.714648:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb7698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+16:2365:x1874607214713472:12345-192.168.202.45@tcp:4:dd.0 Request processed in 3665us (3991us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787764977.714661:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 5 00002000:00100000:1.0:1787764977.714675:0:6655:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (4194304->4722687) req@ffff90dcb7698000 x1874607214713472/t4294967304(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 504/448 e 0 to 0 dl 1787764988 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764977.714686:0:6655:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcb7698000 with x1874607214713472 ext(4194304->4722687) 00002000:00010000:1.0:1787764977.714692:0:6655:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcb7698000 00000100:00100000:0.0:1787764977.847197:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:3.0:1787764977.847233:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214713728 00000100:00100000:3.0:1787764977.847243:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214713728 00002000:00100000:3.0:1787764977.847305:0:6654:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (5242880->6291455) req@ffff90dcbc8e6d00 x1874607214713728/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 488/0 e 0 to 0 dl 1787764988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764977.847317:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbc8e6d00 with x1874607214713728 ext(5242880->6291455) 00002000:00010000:3.0:1787764977.847323:0:6654:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbc8e6d00 00000100:00100000:3.0:1787764977.847356:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 6 00000100:00100000:3.0:1787764977.847366:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+16:2367:x1874607214713728:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:3.0:1787764977.881217:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764977.905340:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787764977.905362:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787764977.912314:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214713600 00000100:00100000:2.0:1787764977.912328:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214713600 00002000:00100000:2.0:1787764977.912395:0:6655:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (6291456->7340031) req@ffff90dcbd1a30c0 x1874607214713600/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 488/0 e 0 to 0 dl 1787764988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764977.912407:0:6655:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbd1a30c0 with x1874607214713600 ext(6291456->7340031) 00002000:00010000:2.0:1787764977.912413:0:6655:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbd1a30c0 00000100:00100000:0.0:1787764977.920569:0:11743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 7 00000100:00100000:0.0:1787764977.920614:0:11743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbd1a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+18:2364:x1874607214713600:12345-192.168.202.45@tcp:4:dd.0 00010000:00010000:2.0:1787764977.998116:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787764978.053276:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+20:2367:x1874607214713728:12345-192.168.202.45@tcp:4:dd.0 Request processed in 205252us (205428us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787764978.053292:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 6 00002000:00100000:1.0:1787764978.053307:0:6654:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (5242880->6291455) req@ffff90dcbc8e6d00 x1874607214713728/t4294967305(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 488/448 e 0 to 0 dl 1787764988 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764978.053317:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbc8e6d00 with x1874607214713728 ext(5242880->6291455) 00002000:00010000:1.0:1787764978.053323:0:6654:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbc8e6d00 00000100:00100000:1.0:1787764978.092357:0:11743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbd1a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5045b8d5-7523-47ae-bf71-6d43e6178916+20:2364:x1874607214713600:12345-192.168.202.45@tcp:4:dd.0 Request processed in 171764us (211138us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787764978.092487:0:11743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 7 00002000:00100000:1.0:1787764978.092501:0:11743:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2:0x0] (6291456->7340031) req@ffff90dcbd1a30c0 x1874607214713600/t4294967306(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:488/0 lens 488/448 e 0 to 0 dl 1787764988 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764978.092512:0:11743:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbd1a30c0 with x1874607214713600 ext(6291456->7340031) 00002000:00010000:1.0:1787764978.092526:0:11743:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbd1a30c0 00000100:00100000:0.0:1787764978.116079:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:0.0:1787764978.116188:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764978.133619:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214713984 00000100:00100000:2.0:1787764978.133636:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214713984 00000100:00080000:0.0:1787764978.133953:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1787764978.134051:0:6655:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (7340032->8388607) req@ffff90dcbc8e7480 x1874607214713984/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:489/0 lens 488/0 e 0 to 0 dl 1787764989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764978.134064:0:6655:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbc8e7480 with x1874607214713984 ext(7340032->8388607) 00002000:00010000:2.0:1787764978.134070:0:6655:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbc8e7480 00000100:00100000:2.0:1787764978.134156:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214713856 00000100:00100000:2.0:1787764978.134162:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214713856 00002000:00100000:2.0:1787764978.134181:0:6655:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (8388608->9437183) req@ffff90dcbc8e7c00 x1874607214713856/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:489/0 lens 488/0 e 0 to 0 dl 1787764989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787764978.134190:0:6655:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbc8e7c00 with x1874607214713856 ext(8388608->9437183) 00002000:00010000:2.0:1787764978.134193:0:6655:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbc8e7c00 00000100:00100000:2.0:1787764978.134222:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 8 00000100:00100000:2.0:1787764978.134233:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+21:2366:x1874607214713984:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:0.0:1787764978.134498:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 9 00000100:00100000:0.0:1787764978.134508:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+21:2365:x1874607214713856:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:1.0:1787764978.195297:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5045b8d5-7523-47ae-bf71-6d43e6178916+24:2365:x1874607214713856:12345-192.168.202.45@tcp:4:dd.0 Request processed in 60783us (79100us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787764978.195308:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 9 00002000:00100000:1.0:1787764978.195319:0:6654:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (8388608->9437183) req@ffff90dcbc8e7c00 x1874607214713856/t4294967307(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:489/0 lens 488/448 e 0 to 0 dl 1787764989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764978.195326:0:6654:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbc8e7c00 with x1874607214713856 ext(8388608->9437183) 00002000:00010000:1.0:1787764978.195331:0:6654:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbc8e7c00 00000100:00100000:3.0:1787764978.205311:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+24:2366:x1874607214713984:12345-192.168.202.45@tcp:4:dd.0 Request processed in 71070us (89232us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787764978.205322:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 8 00002000:00100000:3.0:1787764978.205332:0:6655:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (7340032->8388607) req@ffff90dcbc8e7480 x1874607214713984/t4294967308(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:489/0 lens 488/448 e 0 to 0 dl 1787764989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764978.205340:0:6655:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcbc8e7480 with x1874607214713984 ext(7340032->8388607) 00002000:00010000:3.0:1787764978.205344:0:6655:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcbc8e7480 00000100:00100000:2.0:1787764978.257120:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:1.0:1787764978.258340:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214714112 00000100:00100000:1.0:1787764978.258354:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214714112 00002000:00100000:1.0:1787764978.258410:0:6656:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (9437184->10485759) req@ffff90dcb769b840 x1874607214714112/t0(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:489/0 lens 488/0 e 0 to 0 dl 1787764989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787764978.258422:0:6656:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcb769b840 with x1874607214714112 ext(9437184->10485759) 00002000:00010000:1.0:1787764978.258427:0:6656:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcb769b840 00000100:00100000:1.0:1787764978.258466:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 10 00000100:00100000:1.0:1787764978.258476:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcb769b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+24:2366:x1874607214714112:12345-192.168.202.45@tcp:4:dd.0 00000100:00100000:3.0:1787764978.291084:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcb769b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+26:2366:x1874607214714112:12345-192.168.202.45@tcp:4:dd.0 Request processed in 20419us (21783us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787764978.291124:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 10 00002000:00100000:3.0:1787764978.291144:0:6656:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (9437184->10485759) req@ffff90dcb769b840 x1874607214714112/t4294967309(0) o4->5045b8d5-7523-47ae-bf71-6d43e6178916@192.168.202.45@tcp:489/0 lens 488/448 e 0 to 0 dl 1787764989 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787764978.291155:0:6656:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90dcb769b840 with x1874607214714112 ext(9437184->10485759) 00002000:00010000:3.0:1787764978.291162:0:6656:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90dcb769b840 00000100:00100000:0.0:1787764978.292118:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764978.292195:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214714240 00000100:00100000:2.0:1787764978.292204:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214714240 00000100:00100000:2.0:1787764978.292270:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 38 00000100:00100000:2.0:1787764978.292279:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+13:10115:x1874607214714240:12345-192.168.202.45@tcp:44:dd.0 00000100:00080000:0.0:1787764978.292417:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764978.340403:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbc8e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5045b8d5-7523-47ae-bf71-6d43e6178916+13:10115:x1874607214714240:12345-192.168.202.45@tcp:44:dd.0 Request processed in 48112us (48275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764978.340415:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.45@tcp, seq: 38 00000001:00080000:0.0:1787764978.340448:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000100:00100000:0.0:1787764978.344850:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.45@tcp (source: 12345-192.168.202.45@tcp) 00000100:00100000:2.0:1787764978.344953:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607214714368 00000100:00100000:2.0:1787764978.344972:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607214714368 00000100:00100000:2.0:1787764978.345032:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.45@tcp, seq: 17 00000100:00100000:2.0:1787764978.345042:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbc8e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5045b8d5-7523-47ae-bf71-6d43e6178916+26:2364:x1874607214714368:12345-192.168.202.45@tcp:16:dd.0 00000100:00100000:0.0:1787764978.639789:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbd930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222091904:0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.639871:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764978.639943:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbd912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222092416:0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.639970:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764978.640003:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787764978.640009:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222092032:0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.640033:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787764978.640078:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222091904 00000100:00100000:0.0:1787764978.640084:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222091904 00000100:00100000:0.0:1787764978.640124:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222092032 00000100:00100000:0.0:1787764978.640127:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222092032 00000100:00100000:0.0:1787764978.640157:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787764978.640165:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbd93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222091904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.640219:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbd93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874607222091904:12345-0@lo:400:kworker.0 Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764978.640233:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787764978.640251:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787764978.640258:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbd91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222092032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.640288:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbd91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874607222092032:12345-0@lo:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764978.640294:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787764978.640312:0:6845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222092416 00000100:00100000:0.0:1787764978.640318:0:6845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222092416 00000100:00100000:0.0:1787764978.640346:0:6845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787764978.640352:0:6845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dcbbd921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222092416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.640384:0:6845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dcbbd921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874607222092416:12345-0@lo:400:kworker.0 Request processed in 32us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764978.640390:0:6845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787764978.640406:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787764978.640410:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787764978.640439:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbd92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1874607222092032:0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.640450:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbd930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874607222091904:0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.640457:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787764978.640461:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90dcbce4a940, transno 4294967300 00000100:00100000:0.0:1787764978.640469:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbd912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1874607222092416:0@lo:400:kworker.0 00000100:00100000:1.0:1787764978.640564:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbc8e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222091776:0@lo:400:kworker.0 00000100:00100000:1.0:1787764978.640625:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764978.640645:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbd92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222092288:0@lo:400:kworker.0 00000100:00100000:1.0:1787764978.640665:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764978.640680:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787764978.640685:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90dcbbd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222092160:0@lo:400:kworker.0 00000100:00100000:1.0:1787764978.640703:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787764978.640729:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222092288 00000100:00100000:1.0:1787764978.640738:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222092288 00000100:00100000:1.0:1787764978.640765:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787764978.640775:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222092288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764978.640806:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874607222092288:12345-0@lo:400:kworker.0 Request processed in 31us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764978.640812:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1787764978.640826:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787764978.640833:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222092160 00000100:00100000:1.0:1787764978.640836:0:6648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222092160 00000100:00100000:1.0:1787764978.640857:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787764978.640862:0:6648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83c770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222092160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787764978.640889:0:6648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83c770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1874607222092160:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787764978.640895:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787764978.640920:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787764978.640939:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1874607222092160:0@lo:400:kworker.0 00000100:00100000:1.0:1787764978.640949:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbbd92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1874607222092288:0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.641606:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874607222091776 00000100:00100000:0.0:1787764978.641611:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874607222091776 00000100:00100000:0.0:1787764978.641634:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787764978.641640:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90dc83ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222091776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787764978.641685:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90dc83ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3db9464f-230d-4339-9306-352e25163ce7+19:3289:x1874607222091776:12345-0@lo:400:kworker.0 Request processed in 45us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787764978.641698:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787764978.641781:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90dcbc8e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3db9464f-230d-4339-9306-352e25163ce7:3289:1874607222091776:0@lo:400:kworker.0 Debug log: 10266 lines, 10266 kept, 0 dropped, 0 bad.